AD-A203  195 


ARI  Research  Note  88-94 

Tri-Service  Review  of  Existing  System 
Embedded  Training  (ET)  Components 

Ronnie  E.  Warm,  J.  Thomas  Roth,  Gregg  K.  Sullivan 
Applied  Science  Associates,  Inc. 

M.  Sue  Bogner 
Army  Research  Institute 

for 

Contracting  Officer’s  Representative 
Marshall  A.  Narva 


Manned  Systems  Group 
John  F.  Hayes,  Chief 


Systems  Research  Laboratory 
Robin  L.  Keesee,  Director  ' 

November  1988 


DTIC 

FCTE 
DEC  1  91988 


H 


United  States  Army 


Research  Institute  for  the  Behaviurai  and  Suciai  Sciences 


Approved  for  the  public  release;  distribution  is  unlimited. 


88  13  '19  01 


U.S.  ARMY  RESEARCH  INSTITUTE 

FOR  THE  BEHAVIORAL  AND  SOCIAL  SCIENCES 


A  Field  Operating  Agency  Under  the  Jurisdiction 
of  the  Deputy  Chief  of  Staff  for  Personnel 


JON  W.  BLADES 
COL.  IN 
Commanding 


Research  accomplished  under  contract 
for  the  Department  of  the  Army 

Applied  Science  Associates,  Inc. 


EDGAR  M.  JOHNSON 
Technical  Director 


Technical  review  by 
Irving  N.  Alderman 


NOTICES 

DISTRIBUTION;  This  report  has  been  cleared  for  release  to  the  Defense  Technical  Information 
Center  (DTIC)  to  comply  with  regulatory  requirements.  It  has  been  given  no  primary 
distribution  other  than  to  DTIC  and  will  be  available  only  through  DTIC  or  the  National 
Technical  Informational  Service  (NTIS). 

FINAL  DISPOSITION;  This  report  may  be  destroyed  when  it  is  no  longer  needed.  Please  do  not 
return  it  to  the  U.S.  Army  Rcscareli  Institute  fur  the  Bcliaviuiiii  diiu  Sueial  ScieiiCeS. 

NOTE;  The  views,  opinions,  and  Findings  in  this  report  are  those  of  the  author(s)  and  should  not 
to  be  construed  as  an  official  Department  of  the  Army  position,  policy,  or  decision,  miess  so 
designated  by  other  authorized  documents. 


UNCLASSIFIED _ 

SEtuRlTr  CLASSifiCATiON  OF  THIS  PAGE 


la  REPORT  SECURITY  CLASSIFICATION 

Unclassified 

2a  security  CLASSIFICATION  AUTHORITY 
2b  DECLASSIFICATION /DOWNGRAOING  SCHEDULE 

I _ ~~  _ 

4  PERFORMING  ORGANIZATION  REPORT  NUM0ER(S) 


REPORT  DOCUMENTATION  PAGE 

ION  I  lb.  RESTRICTIVE  MARKINGS 


Form  Approved 
OMBNo  0704-018$ 


6a  NAME  OF  PERFORMING  ORGANIZATION 

Applied  Sciences  Associates,  Ir 

"erToORESrTorrTfatTTJdziPCoaiJT”’"”' 
P.O.  Box  1072 
Butler,  PA  16003 


6b  OFFICE  SYMBOL 
(If  tpplietbit) 


3.  distribution /availability  OF  REPORT 

Approved  for  public  release; 
distribution  is  unlimited 

S.  monitoring  organization  report  NUMBER(S) 

ARI  Research  Note  88-94 

7*  name  of  monitoring  organization 
[  U.S.  Army  Research  Institute  for 
the  Behavioral  and  Social  Sciences 

7b  ADDRESS  (Oty,  State,  artd  ZIPCoch) 

5001  Eisenhower  Avenue 
Alexandria,  VA  22333-5600 


8a.  NAME  OF  FUNDING  /  SPONSORING 
ORGANIZATION 

_ see  7a. _ 

8c  ADDRESS  (City,  Statt.  and  ZIP  Codt) 

see  7b. 

1 1  TITLE  (Includt  Security  Classification) 


8b  OFFICE  SYMBOL  9.  PROCUREMENT  INSTRUMENT  IDENTIFICATION  NUMBER 

(If  applicable)  MDA903-85-C-0078 


PERI-SM 


10  SOURCE  OF  FUNDING  NUMBERS 
PROGRAM  I  PROJECT  I 


6.27.17 


PROJECT 

task 

2Q1627 

1.2.7 

17A790 

1.4.2 

WORK  UNIT 
ACCESSION  NO 


Tri-Service  Review  of  Existing  System  Embedded  Training  (ETl  Components 

12.  PERSONAL  AUTHORlS) 

Ronnie  E.  Warm,  J.  Thomas  Roth,  Gregg  K.  Sullivan,  and  M.  Sue  Boonet 

i3a.  TYPE  OF  REPORT  13b  TIME  COVERED  14.  DATE  OF  REPORT  (Year,  Month,  Day)  jl5.  PAGE  COUNT 

Final  Report  from  sa-ll  tq  ^7,^  November  1988  I  130 

16.  SUPPLEMENTARY  NOTATION 

Marshall  A.  Narva 


17  '  COSATl  COOES  18  SUBJECT  TERMS  {Continue  on  reverse  if  necessary  and  identify  by  block  number) 

FIELD  GROUP  SUB-GROUP  Training  System  Design  Requirements 

_ _  Training  System  Development 

_  LI,  Embedded  Training 

19  ABSTRACT  (Continue  on  reverse  if  necessary  and  identify  by  block  number) 

^‘When  it  is  used  as  an  integral  part  of  system  design,  Embedded  Training  (ET)  offers  what 
appears  to  be  a  unique  cost-effective  training  capability.  As  part  of  an  effort  to  develop 
and  implement  procedures  for  designing  ET,  a  survey  of  tlie  ET  systems  already  fielded  was 
conducted,  in  order  to  identify  the  ET  system  characteristics  which  could  be  included  in 
an  ET  component  for  an  array  of  systems,  missions,  and  training  and  operational  environments; 
The  data  gathered  during  this  review  will  b/  used  in  the  development  of  ET  design  procedures 
to  incorporate  lessons  learned  from  earlier  ET  component  developments.  -  I 

1 I  .v'‘\  vV.c'_.vr^  ..'M  .  '..  U'  ■ '  i  i.i  •■  /  ! 


20  DISTRIBUTION' availability  OF  ABSTRACT 

C3  unclassified  UNLIMITED  □  SAME  AS  RPT  □  QTIC  USERS 
22a  NAME  OF  RESPONSIBLE  INDIVIDUAL 


21  ABSTRACT  SECURITY  CLASSIFICATION 


|22b  telephone  (Include  Area  Code)  I  22c.  OFFICE  SYMBOL 


DD  Form  1473.  JUN  86 


Previous  editions  are  obsolete 


security  CLASSIFICATION  OF  THIS  PAGE 

UNCLASSIFIED 


1 


TABLE  OF  CONTENTS 


EXECUTIVE  SUMMARY  .  .  . 

PREFACE . 

LIST  OF  ACRONYMS  .  .  .  . 

SECTION  1.  INTRODUCTION 

Background  . 

Purpose  . 

Report  Overview  .  .  . 


SECTION  2.  APPROACH  . 

System  Selection  . 

Data  Collection  . 

Questionnaire  Development  ..  . 

Site  Visits  . 

Documentation  .  . 

Data  Analysis  . 

Evaluate  the  Design  and  Development  of  the  ET  System  .  .  . 

Determine  the  ET  Component  Characteristics  . 

Determine  the  ET  Features  . 

Determine  the  Impact  Factors  Affecting  the  Use  of  ET  .  .  . 

ET  Training  Functions  . 

Determine  Objective  Categories  Trained  and  Levels  of 

Training  . 


SECTION  3.  DATA  ANALYSIS  RESULTS  .  .  . 

ET  Component  Characteristics  .... 
ET  Training  Features  .  . 

Computer-Oriented  Features  .... 
Training  Management  Features  .  .  . 
Automated  Training  Features  .  .  . 
Scenario  Control  Features  .... 

Instructional  Features  . 

ET/System  Coordination  Features 

Impact  Factors  Affecting  the  Use  of  ET 


...1 


Logistical  Impact  ra»-to.s 
Time  Impact  Factors  .  . 
Operating  Impact  Factors 


21 

22 

24 


TABLE  OF  CONTENTS 
(CoQtiaued) 


Pa;je 


ET  Training  Functions  .  27 

Task  Categories  Trained  .  27 

Training  Uses .  28 

Types  of  ET  Training  . .  30 

Objective  Categories  Trained  .  31 

Levels  of  Training .  31 

SECTION  4.  DISCUSSION  .  34 

General  Observations  on  Embedded  Training  .  34 

ET  Development  and  the  System  Development  Process  .  35 

ET  Utilixation  and  Relationships  with  System  Constraints  .  .  37 

ET  Utilization  and  Impacts .  38 

Training  Characteristics  and  ET  .  38 

Types  of  Training  Provided  by  ET .  39 

Scenarios  and  Scenario  Requirements  .  41 

ET  Interactions  with  Logistics  .  41 

Software  and  Courseware  Logistics  .  .  .  42 


APPENDIX  A.  PATRIOT  MISSILE  SYSTEM— TROOP  PROFICIENCY 

TRAINER  (TPT)  .  A~1 

APPENDIX  B.  MISSILE  MINDER  CCWMAN^  AND  CONTROL  SYSTEM  .  B~1 

APPENDIX  C.  IMPROVED  HAWK  (IHAWK)  MISSILE  SYSTEM— TPQ-29 

TRAINER .  C-1 

APPENDIX  D.  WORLEHWIDE  MILITARY  COMMAND  AND  CONTROL  SYSTEM 

(WWMCCS)  .  D-1 

APPENDIX  E.  F-15  ON-BOARD  SIMULATION  (OBS)  SYSTEM  .  E-1 

APPENDIX  F.  AIRBORNE  WARNING  AND  CONTROL  SYSTEM  (AWACS)  ....  F-1 

APPENDIX  G.  F-14  IN-FLIGHT  TPJ^INING  (IFT)  SYSTEM .  G-1 

APPENDIX  H.  CG-47  AEGIS  WEAPON  SYSTEM— AEGIS  COM  HAT  TRAINING 

SYSTEM  (ACTS)  .  H-1 


TABLE  OF  CONTENTS 
(Continued) 


Page 


APPENDIX  I.  DDG-993  COMBAT  SYSTEM— COMBAT  SIMULATION  TEST 

SYSTEM  (CSTS)  .  I-l 

APPENDIX  J.  PROGRAM  MANAGER  DATA  GATHERING  FORM .  J-1 

APPENDIX  K.  TRAINING  MANAGEMENT  DATA  GATHERING  FORM .  K-1 

APPENDIX  L.  TRAINEE  DATA  GATHERING  FORM .  L-1 

APPENDIX  M.  MAINTAINER  DATA  GATHERING  FORM .  M-1 


V 


LIST  OF  TABLES 


Table  Page 


1  ET  Training  Management  Features  .  13 

2  Automated  ET  Training  Features  .  15 

3  ET  Scenario  Control  Features  .  17 

4  ET/S/stem  Coordination  Features  .  19 

5  ET  Tine  Impact  Factors .  22 

6  Operating  Impact  Factors  .  25 

7  Task  Categories  Trained  .  27 

8  Training  Uses  of  ET .  29 

9  Types  of  ET  Training .  30 

10  Training  Levels  for  ET .  32 


LIST  OF  FIGUEIES 

Figure  Page 

A-1  Patriot  Missile  System  Battery  Compliment  .  A-2 

A-2  TFT  Target  Data  Printout . A-4 

B-1  AN/TSQ-73  Missile  Minder  Shelter  .  B-3 

B-2  Missile  Minder  Raid  Sununary  Report . B*5 

C-1  I8AWK  Missile  System  Components  .  ....  C-2 

E-1  F-15  Heads-Up  Display  (HDD)  .  E-2 

F-1  Situation  Display  Console  of  AWACS  .  F-3 

H-1  CG-47  Class  Cruiser  Primary  Weapon  Systems  and  Locations  H-3 

H-2  CIC  Weapon  System  Control  Stations  .  H-5 

I-l  DDG-993  Class  Destroyer  Primary  Weapon  System  Locations  .  1-3 

1-2  DDG-993  Combat  Information  Center  .  1-5 


VI 


ZXECUTIVE  SUMMARY 


Requirement 

The  objective  of  this  effort  was  to  systematically  examine  the 
Embedded  Training  (ET)  components  and  the  characteristics  of  ET 
implementation  in  a  selected  set  of  systems  currently  operational  in 
the  Army,  Navy,  and  Air  Force,  to  explore  the  manner  in  which  ET 
components  have  been  developed  and  employed,  and  to  attempt  to  derive 
principles  and  "lessons  learned"  which  may  be  of  value  in  providing 
guidance  for  the  development  of  future  ET  components  for  Army  systems. 


Approach 

Nine  systems  with  ET  components,  three  each  from  the  Army,  Navy, 
and  Air  Force,  were  selected  to  meet  a  set  of  criteria  developed  as 
part  of  the  effort.  Interview  protocols  and  questionnaires  for  data 
collection  from  four  classes  of  personnel  believed  to  possess  critical 
information  about  the  capabilities  and  development  of  the  systems  and 
their  respective  ET  components  were  prepared. 

Sice  visits  were  conducted  Co  units  and  commands  where  such 
personnel  were  identified  for  each  of  Che  nine  systems.  At  Chose 
sices,  the  systems  and  their  ET  components  were  examined,  where 
possible,  and  interviews  with  nunerous  personnel  were  conducted. 
Additional  documentation  about  Che  systems  and  their  ET  components  was 
also  gathered  when  available,  to  supplement  the  interview  and 
questionnaire  data  during  analysis. 

Analyses  concentrated  on  identifying  specified  characteristics  of 
the  ET  components  and  Che  systems  with  which  e&ch  component  was 
associated,  characterizing  Che  training  provided  by  ET,  identifying 
factors  associated  with  Che  design  and  development  of  the  ET 
components,  and  assessing  impacts  on  Che  operation  and  logistics  of  Che 
systems  associated  with  Che  presence  of  the  ET  components.  The  results 
of  the  direct  analyses  of  data  were  considered  along  with  anecdotal 
data  gathered  during  data  collection  interviews,  Co  identify 
commonalities  across  the  systems  and  Co  attempt  to  derive  general 
findings  Chat  would  be  of  value  in  developing  guidance  for  future 
development  of  ET  components. 


Findings 


Little  commonality  of  actual  implementation  was  found  across  the 
nine  ET  components  studied,  save  Chat  each  utilized  some  sort  of  input 
and  display  device,  and  was  controlled  by  computers  embedded  in  or 
scrapped  onto  the  prime  item  systems.  Each  of  the  ET  components 
provided  principally  skill  sustainment  training  by  providing  task- 
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related  stimuli  to  system  operators.  A  number  of  the  ET  components 
were  effectively  utilized  for  team  training  for  operators  within  the 
same  system,  and  several  were  capable  of  providing  stimuli  to  support 
coordinated  training  on  dissimilar  systems,  through  tactical 
communications  links.  None  of  the  ET  components  studied  were  able  to 
support  training  for  maintenance,  although  that  capability  was 
reportedly  to  be  considered  for  retrofit  in  some  cases. 

Training  provided  by  each  of  the  ET  components  was  judged  to  be  of 
value  by  the  various  user  groups  from  whom  data  was  gathered.  Each  of 
the  ET  components  had  both  strong  and  weak  characteristics  from 
training  and  implementation  points  of  view,  but  all  provided  effective 
training  within  their  limitations.  No  advanced  training  support  or 
training  management  features  were  incorporated  in  any  of  the  ET 
components  (not  a  surprising  finding  when  considering  the  state  of  the 
art  at  the  time  each  was  developed).  In  all  but  one  of  the  ET 
components  studied,  ET  was  implemented  as  system  software  elements, 
rather  than  as  separate  courseware,  able  to  be  updated  independently  of 
system  software  updates. 

The  presence  of  ET  in  the  systems  studied  generally  was  found  to 
have  neutral  effects  on  logistic  demands  and  maintenance  requirements. 
Some  indications  were  found  that  ET  components  developed  concurrent 
with  the  associated  prime  item  systems  may  have  fewer  logistic  impacts 
than  those  added  as  retrofit  capabilities.  No  particular  differences 
in  effectiveness  or  training  support  capability  were  found  between  ET 
components  wholly  integrated  into  the  design  of  prime  iten  systems  vice 
"strap-on"  implementations.  The  only  strap  on  ET  component  studied  is 
probably  atypical,  and  there  is  no  basis  to  conclude  that  there  is  any 
inherent  disadvantage  to  strap-on  ET  components  as  opposed  to  wholly 
integrated  ET. 

In  general,  the  ET  provided  by  the  components  studied  was  found  to 
be  effective  and  well-accepted  by  users.  A  common  expression  during 
the  interviews  was  that  additional  ET  capability  is  desirable  and  would 
be  utilized  to  support  training  in  the  units  where  it  is  available. 


Utilization  of  Findings 


The  results  of  this  survey  will  be  combined  with  those  of  two 
parallel  survey  efforts  (one  of  eight  Army  systemj  both  with  and 
without  ET  components;  the  second  dealing  with  technology  applications 
which  may  have  impacts  on  future  ET  developments)  to  derive  general 
guidelines  and  procedures  for  the  effective  design  and  development  of 
ET  components  for  current  and  future  Army  systems. 
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SECTION  1 


INTRODUCTION 


Background 


With  the  increasing  complexity  of  weapon  systems  and  new  applica¬ 
tions  of  technology,  training  requirements  for  weapon  and  other  systems 
have  increased  in  both  schools  and  in  operational  units.  With  the 
implementation  of  new  technologies,  particularly  computers  embedded  in 
systems,  it  has  become  possible  to  include  a  training  component  within 
the  prime  equipment.  Training  in  which  the  trainee  interacts  with  the 
actual  system  controls,  displays,  and  other  operational  hardware  is 
termed  "Embedded  Training  (ET)." 

ET  takes  place  on  the  actual  weapon  system.  The  weapon  system  is 
stimulated  by  an  integrated  ET  component  or  subsystem,  or  an  external 
strap-on  ET  component.  Training  on  the  actual  weapon  system  with  ET 
provides  realistic  training  in  the  actual  performance  environment. 
Training  realism  is  often  difficult  and  expensive  to  implement  in  a 
stand-alone  training  device.  ET  benefits  units  by  being  available  at 
their  site,  hence  providing  more  efficient,  frequent,  and  cost- 
effective  sustainment  training  capability,  at  least. 

There  have  been  many  attempts  by  the  military  to  use  ET  to  support 
unit  training  requirements.  This  report  presents  the  data  collected  on 
nine  weapon  systems  and  tVici.  respective  ET  components.  As  part  of  a 
program  to  develop  system  design  concepts  lor  ET,  sponsored  by  the  Army 
Research  Institute  (ARI)  for  the  Behavioral  and  Social  Sciences  and  the 
Project  Manager  for  Training  Devices  (PM  TRADE),  a  review  of  existing 
ET  components  in  the  three  armed  services  was  conducted.  Data  were 
collected  on  the  characteristics  of  Che  ET  components  and  systems  in 
which  they  are  embedded,  as  well  as  experience  with  using  the  ET 
components  to  gather  "lessons  learned."  The  results  of  this  review 
will  feed  into  Che  development  of  guidelines  and  procedures  for  ET 
decision  and  design,  Co  be  utilized  in  the  system  acquisition  process. 
This  review  is  a  subCask  of  ET  program  Task  2  and  is  a  parallel  effort 
Co  reviews  of  Army  systems  with  and  without  ET  and  of  potential 
technologies  for  implementing  ET  in  current  and  future  systems. 


Purpose 


The  data  presented  here  and  the  results  of  the  analysis  performed 
during  this  review  have  been  used  for  generating  conclusions  concerning 
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how  Co  conduct  future  ET  development  efforts.  The  results  of  this 
review  will  feed  into  the  development  of  guidelines  and  procedures  for 
the  development  of  ET  components  in  Army  systems. 


Report  Overview 

The  remainder  of  this  report  consists  of  three  major  sections  and 
13  Appendices. 

Section  2  explains  the  approach  used  in  performing  this  subcask. 
First,  the  selection  of  systems  for  this  review  is  presented.  Next, 

Che  development  of  the  data  collection  forms  and  Che  questionnaires  is 
summarized.  Finally,  data  analysis  is  discussed. 

Section  3  presents  an  overall  summary  of  Che  nine  systems  reviewed 
end  the  results  of  Che  data  analysis.  The  data  are  derived  from  the 
detailed  system  summaries  presented  in  Appendices  A  through  I,  which  in 
Cum  are  derived  from  Che  data  collection.  The  summaries  are  presented 
mainly  by  Cables  Chat  show  the  characteristics  of  the  various  ET 
components.  The  results  of  the  data  analysis  include  commonalities  and 
differences  among  ET  components  found  during  Che  analysis.  This 
section  is  divided  into  the  following  subsections,  corresponding  to  the 
data  collection  effort:  ET  Component  Characteristics,  ET  Training 
Features,  Impact  Factors  Affecting  The  Use  of  ET,  and  ET  Training 
Functions. 

Section  4  presents  a  discussion  of  Che  analysis  results  in  Section 
3  in  Che  form  of  identifying  apparent  commonalities  among  the  ET 
components  and  their  implementation.  The  discussion  is  based  on 
tentative  findings  from  evaluating  the  nine  ET  components.  Some 
recommendations  are  based  on  anecdotal  and  interview  comments  data 
which  are  not  presented  in  Section  3. 

Appendices  A  through  I  are  summaries  of  the  characteristics  of  the 
systems  and  ET  components  included  in  Che  review.  Appendices  J  through 
M  present  samples  of  the  questionnaires  used  during  the  data  collection 
process . 
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SECTION  2 


APPROACH 


System  Selection  and  Data  Gathering  Approach 


An  initial  list  of  weapon  systems  with  ET  components  was  used  as  a 
point  of  departure  for  selecting  the  systans  and  ET  components  that 
would  be  used  for  the  review.  A  set  of  criteria  were  developed  for 
selecting  ET  components  for  the  review.  These  criteria  were  developed 
and  applied  to  ensure  that  a  balanced  cross  section  of  ET  components 
from  the  three  services  were  selected. 

The  systems  in  the  initial  list  were  evaluated  by  applying  the 
selection  criteria.  Based  upon  this  evaluation,  several  of  the  systans 
on  the  initial  list  were  deleted  and  new  systems  that  collectively  met 
the  criteria  were  selected.  The  following  systems  and  ET  components 
were  selected  for  this  review. 

1.  Army  Systems: 

a.  Patriot  Missile  System  Troop  Proficiency  Trainer 
(TPT) ; 

b.  Missile  Minder  Command  and  Control  System; 

c.  Hawk  Missile  System  Radar  Signal  Simulator 
(AN/TPQ-29), 

2.  Air  Force  Systems: 

a.  World-Wide  Military  Command  and  Control  System 
(WWMCCS) ; 

b.  F-15  On-Board  Simulator  (OBS); 

c.  E-3A  Airborne  Warning  and  Control  System  (AWACS) . 

3.  Navy  Systems: 

a.  F-14  In-Flight  Trainer  (IFT); 

b.  CG-47  Class  Cruiser  Aegis  Combat  Training  System 
(ACTS); 

c.  DDG-993  Class  Destroyer  Combat  Simulation  Teat 
System  (CSTS) . 


Data  Collection 


Questionnaire  Development 

The  initial  list  of  information  elements  to  be  collected  during 
the  tri-services  review  is  shown  below: 

1.  The  types  of  tasks  and  skills  acquired  using  the  ET 
component ; 

2.  The  type  of  weapon  system; 

3.  Constraints  of  the  prime  equipment; 

4.  Major  hardware  of  the  ET  component; 

5.  Availability  of  the  prime  equipment  for  ET; 

6.  Types  of  tasks  taught  using  the  ET  component  (including 
operational  tasks,  maintenance  tasks,  and  team  tasks); 

7.  When  and  how  the  ET  component  is  used; 

8.  Time  to  activate  the  ET  component; 

9.  Time  to  disengage  the  ET  component; 

10.  Types  of  training  performed  in  the  off-line  and  on-line 
modes ; 

11.  The  types  of  media  and  technologies  used  by  the  ET 
components ; 

12.  Similarities/contrasts  between  the  ET  and  prime  equipment 
input  devices; 

13.  Ability  of  the  ET  component  to  meet  local  (unit)  training 
requirements; 

14.  Estimate  of  the  developmental  cost  of  ET; 

15.  Perceived  benefits  of  the  ET  component; 

16.  Perceived  problems  with  the  ET  component; 

17.  Attitude  of  the  trainees  toward  the  use  of  ET; 

18.  Who  maintains  the  ET  software,  courseware,  and  hardware; 
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19.  Estimated  downtime  of  the  ET  systsn; 

20.  Whether  having  ET  increased  the  parts  required  for  the 
weapon  system; 

21.  Whether  using  the  ET  component  prevented  the  weapon  system 
from  performing  an  operational  mission; 

22.  Is  coonnercially  available  software  used; 

23.  How  the  ET  component  was  developed  and  fabricated; 

24.  What  instructional  features  the  ET  component  has  (i.e., 
freeze,  playback,  fast  forward,  demonstration  mode,  help 
facilities,  and  performance  analysis): 

25.  Whether  the  ET  component  is  used  for  sustainment  training; 

26.  Whether  negative  transfer  of  training  results  from  using 
the  ET  component. 

This  initial  list  of  data  items  was  used  to  develop  data  collection 
forms  and  structured  interview  protocols.  Four  separate  questionnaires 
were  developed,  one  for  use  with  each  of  the  following  classes  of 
personnel:  Program  Manager,  Training  Supervisor,  Trainee,  and 
Maintenance.  Examples  of  these  questionnaires  are  contained  in 
Appendices  J  through  M.  Data  collection  instruments  were  developed  in 
such  a  fashion  as  to  ensure  data  commonality  between  this  review  and 
the  parallel  review  of  Army  systems  with  and  without  ET  components 
(Strasel,  Dyer,  Aldrich,  and  Furroughs,  1986). 


Site  Visits 

At  least  one  site  visit  was  arranged  for  each  ET  component 
selected  for  Che  review.  At  the  sites,  data  collectors  interviewed 
users  of  Che  systems  and  ET  components  and,  when  possible,  observed  Che 
equipment  being  used.  At  the  end  of  each  site  visit,  questionnaires 
were  left  for  Che  classes  of  personnel  not  available  for  interview. 

The  list  below  shows  the  locations  of  all  the  site  visits  and  the 
systems  associated  with  each  site  visit. 

1.  U.  S.  Army  Air  Defense  Artillery  School  (USAADASCH),  Fort 
Bliss,  Texas — Patriot  Missile  System  TPT,  Missile  Minder 
Command  and  Control  System,  and  AN/TPQ-29; 

2.  966  AWACS  STS/CC,  Tinker  Air  Force  Base  (AFB),  Oklahoma— 
AWACS; 

3.  Air  Force  Wright  Aeronautical  Laborator res ,  Wright- 
PatCerson  APB,  Ohio — P-15  OBS; 


4.  Air  Trainir.z  Command,  Reesler  AFF,  Louisiana — WWMCCS; 

5.  Naval  Training  Systems  Center  (NTSC),  Orlando,  Florida-ACTS 
and  CSTS  introduction  and  overview  of  ET  in  the  three 
services; 

6.  Naval  Ocean  System  Command  (NOSC),  Point  Loma,  California — 
ACTS  and  CSTS; 

7.  Naval  Surface  Warfare  Center  (NSWC),  Dahlgren,  Virginia — 
ACTS  and  CSTS; 

8.  Navy  Personnel  Research  and  Development  Center  (NPRDC), 
Point  Loma,  California — F-14  IFT; 

9.  VF-124,  Naval  Air  Station  (NAS)  Miramar,  California — F-14 
IFT; 

10.  NAS  Point  Mugu,  California— F-14  IFT. 


Documentation 


During  the  site  visits,  documents  useful  for  the  review  effort 
were  identified  and,  when  possible,  copies  of  these  documents  were 
obtained.  The  documents  provided  a  supplement  to  site  visit  data  in 
cases  when  all  the  required  data  were  not  available.  A  complete  list 
of  the  documents  used  during  the  review  is  presented  in  the 
Bibliography. 


Data  Analysis 


The  data  items  were  categorized  to  aid  the  data  analysis  process. 
The  data  gathered  from  documents  and  site  visits  were  placed  in  a  data¬ 
base  management  system.  The  various  data  items  were  summarized  across 
the  three  services  and  within  each  service,  to  identify  commonalities 
and  contrasts.  The  data  analysis  was  conducted  in  six  major  steps 
which  are  summarized  in  this  subsection. 


Evaluate  the  Design  and  Development  of  the  ET  System 

This  part  of  the  analysis  identified  which  ET  components  were 
developed  in  parallel  with  system  development  and  which  were  added 
after  the  initial  weapon  system  had  been  delivered.  How  and  when  the 
ET  component  is  updated  was  also  determined.  The  analysts  looked  for 
problems  associated  with  the  time  of  ET  development  as  related  to  the 
system  life  cycle. 
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Determine  the  ET  Component  Characteristics 


This  task  involved  identifying  the  characteristics  of  the  major 
components  of  e.ich  system  and  which  components  were  used  with  ET. 
Components  added  to  implement  ET  and  components  not  used  during  ET  were 
also  identified.  It  should  be  noted  that  the  list  of  possible 
components  is  merely  a  "menu"  used  to  organize  data  collection  and 
analysis  efforts.  It  was  not  expected  that  all  characteristics  might 
be  found  in  any  one  system  reviewed.  In  fact,  given  the  time  frame 
during  which  many  of  the  systems  were  developed,  a  number  of  the 
characteristics  and  technologies  included  on  the  list  were  not 
sufficiently  mature  to  have  been  considered  for  inclusion  in  the  system 
or  ET  component  designs.  Many  of  these  characteristics,  as  well  as 
even  more  advanced  ones,  may  be  considered  for  future  ET  components. 
Thus,  it  was  desirable  to  explore  any  of  the  characteristics  that  might 
have  been  included  in  the  systems  reviewed.  The  following  component 
characteristics  list  was  used  for  this  task  in  the  analysis: 

1.  Output  devices  and  displays: 


a. 

Color  Cathode-Ray  Tube 

(CRT)  ; 

b. 

Monochrome  or  B/W  CRT; 

c. 

Liquid  Crystal  Display 

(LCD)  ; 

d. 

Light  Emitting  Diode  (LED); 

e. 

Printer. 

Input 

devices: 

a. 

Light  pen; 

b. 

Cursor  positioning; 

c. 

Numeric  keypad; 

d. 

Alphanumeric  keyboard; 

e. 

Alphanumeric  keypad. 

3.  Control  devices: 


a.  Trackball; 

b.  Joystick; 

c.  Touch  screen; 

d.  Mouse; 

e.  Cue/menu  response; 

f.  Special-function  keys. 

4.  Storage  devices: 

a.  Magnetic  tape  spool  (streaming  tape); 

b.  Magnetic  tape  cartridge; 

c.  Magnetic  hard-disk  cartridge; 

d.  Magnetic  floppy  disk; 

e.  Built-in  hard  disk; 

f.  Video  disk; 

g.  Slides. 
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Determine  the.  ET  Features 

This  task  involved  identifying  the  various  features  available  as 
part  of  Che  ET  components  of  each  system.  As  with  the  exploration  of 
characteristics  of  ET  camponenC8»  not  all  features  were  expected  to  be 
present  in  any  (or  all)  of  the  systems  reviewed.  For  similar  reasons, 
however,  highly  advanced  features  were  considered  in  the  review  to 
capture  any  data  that  might  be  available.  Related  features  were 
grouped  into  manageable  categories.  The  features  considered  in  this 
part  of  Che  analysis  are: 

1.  CompuCer-Oriented  Features; 

a.  Computer  Assisted  Instruction  (CAI); 

b.  Artificial  Intelligence  (Al) ; 

c.  Computer  Generated  Imagery  (CGI). 

2.  Training  Management  Features: 

a.  Adaptive  training; 

b.  Scenario  authoring; 

c.  Built-in  recordkeeping; 

d.  On-line  scenario  modification. 

3.  Automated  Training  Features: 

a.  Performance  feedback; 

b.  Performance  recording; 

c.  Performance  measuring; 

d.  Report  generation. 

4.  Scenario  Control  Features: 

a.  Scenario  freeze; 

b.  Scenario  fasC-f orvard ; 

c.  Scenario  playback. 

5.  Instructional  Features: 

a.  Demonstration  training  mode; 

b.  User-help  facility. 

6.  ET/System  Coordination  Features; 

a.  Integrated  or  sCrap-on; 

b.  Off-line  capability; 

c.  On-line  capability; 

d.  Collective  training. 
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Determine  the  Impact  Factors  Affecting  the  Use  of  ET 

This  task  consisted  of  an  analysis  of  user  comments  about  specific 
problems  encountered  at  the  unit  that  impacted  the  use  of  the  ET 
components.  The  impact  factors  were  grouped  under  three  major  topics. 
The  following  impact  factors  were  identified  for  this  task  of  the 
analysis: 


1.  Logistical  Impact  Factors: 

a.  Whether  ET  increased  parts  needs; 

b.  Whether  ET  increased  maintenance  requirements; 

c.  Whether  using  ET  increased  wear  of  the  weapon 
system; 

d.  Whether  ET  had  significant  equipment  or  operating 
differences  from  the  weapon  system. 

2.  Time  Impact  Factors: 

a.  Amount  of  system  down  time; 

b.  Trainee  availability; 

c.  Equipment  availability; 

d.  Life  cycle  phase  when  the  ET  component  was 
developed. 

3.  Operating  Impact  Factors: 


a. 

How  easy 

it 

is 

to 

initialize  ET; 

b. 

How  easy 

it 

is 

to 

shut  down  ET; 

c. 

How  easy 

it 

is 

to 

operate  the  weapon  system; 

d. 

How  easy 

it 

is 

to 

operate  the  ET  component; 

e. 

Time  it 

takes 

to 

initialize  ET; 

f. 

Time  it 

takes 

to 

shut  down  ET. 

ET  Training  Furictxoiia 


This  task  involved  itemizing  the  capabilities  of  the  ET  components 
and  determining  the  functions  of  the  ET  in  terras  of  training.  The 
following  functions  were  used  for  this  part  of  the  analysis: 
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1.  Task  Cacegories  Trained: 


a.  Equipoenc  operation  tasks; 

b.  Team  operation  tasks; 

c.  Maintenance  tasks. 


2.  Training  Uses; 

a.  Individual  training; 

b.  Team  training; 

c.  Preparatory  exerciser; 

d.  Readiness  evaluations. 


3.  Types  of  ET  Training: 


a.  Full-mission-scenario  training; 

b.  Part-mission-scenario  training; 

c.  Part-task  training. 


Determine  Objective  Categories  Trained  and  Levels  of  Training 

Finally,  an  attempt  was  made  to  identify  characteristics  of  the 
training  provided  by  the  various  ET  components.  This  task  is  based  on 
knowledge  about  ET  gained  since  the  start  of  the  ET  research  program, 
inferences  about  the  systems  reviewed  and  their  ET  components,  and  the 
data  collected.  The  other  analysis  tasks  only  considered  the  data  as 
collected.  The  following  training  categories  and  training  levels  were 
used  for  this  part  of  the  analysis: 

1.  Objective  Categories: 

a.  Basic  manipulative  skills; 

b.  Invariant  procedures; 

c.  Variable/ contingency  procedures; 

d.  Knowledges; 

e.  Rule/ concept  utilization; 

f.  Multiple  integrated  skills. 

2.  Training  Levels: 

a.  Initial; 

b.  Sustainment; 

c.  Full  mastery. 
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SECTION  3 


DATA  ANALYSIS  RESULTS 


An  overall  view  of  the  nine  selected  ET  components  indicates  there 
is  a  great  diversity  among  ET  components  within  each  service  and  among 
the  services.  Each  ET  component  reviewed  had  some  favorable 
characteristics;  however,  no  two  systems  were  very  similar  in  design. 
The  only  characteristics  common  to  all  of  the  ET  components  were  the 
perceived  benefits  of  ET  and  the  acceptance  level  of  the  ET  concept  (ET 
is  held  in  high  esteem  among  the  weapon  systems'  users  in  the  three 
services)  and  the  fact  that  each  ET  component  used  some  type  of 
display,  input,  and  control  device. 

In  interpreting  the  information  presented  here,  the  reader  should 
keep  in  mind  the  fact  that  most  of  the  systems  and  ET  components 
reviewed  have  been  fielded  for  some  time.  Thus,  they  reflect  the 
hardware  and  software  technology  state  of  the  art  at  the  time  they  were 
developed.  Even  though  the  data  collection  format  identified  such 
features  as  AI  and  videodisc,  these  features  were  absent  from  all  of 
the  systems  reviewed. 

In  this  section,  a  summary  of  the  data  collected  on  the  selected 
ET  components  is  presented,  along  with  the  results  of  data  analyses. 

The  analyses  performed  during  this  review  involved  direct  analysis  of 
the  data  collected,  application  of  known  human  factors  and  training 
principles,  and  the  consideration  of  ET-specific  data  gathered  since 
the  start  of  the  overall  ET  program.  The  data  analyzed  in  this  section 
are  directly  derived  from  the  system  data  summaries  presented  in 
Appendices  A  through  I. 


ET  Component  Characteristics 


In  general,  ET  appeared  not  to  have  negative  impacts  upon  system 
operation  or  person-ma chine  interferes.  Additional  equipment  beyond 
chat  incorporated  in  the  prime  system  was  necessary  only  in  the  case  of 
the  AN/TPQ~29,  which  is  a  strap-on  ET  component.  Training-specific 
displays  and  controls  in  support  of  ET  were  incorporated  in  only  one  of 
Che  systems  reviewed — CSTS.  The  CSTS  required  the  installation  on 
board  ship  of  several  general  purpose  computers  and  a  Test  Control 
Console  (TCC)  which  served  as  Che  instructor  station.  These  computers 
and  controls  wore  not  used  in  the  operatioiial  muue  auu  Lhut*  had  no 
direct  impact  upon  system  operabil  icy. 
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Gertfirally,  the  ET  coopoaeats  were  physically  iadistiaguishable 
from  the  remainder  of  the  flyatems*  user-system  interfaces.  Normal 
operating  controls  and  displays  were  used  to  conduct  training  via  ET  in 
al].  but  one  case  (AM/TFQ-29)i  the  only  strap-on  ET  component  studied. 


ET  Training  Features 


Training  features  are  those  aspects  of  a  training  system  (usually 
hardware  or  software,  although  sometimes  courseware)  Chat  facilitate 
training  or  allow  laarning  to  occur.  In  this  report  these  have  been 
subdivided  into  six  categories: 

1.  Computer-Oriented  Features; 

2.  Training  Management  Features; 

3.  Automated  Training  Features; 

4.  Scenario  Control  Features; 

5.  Instructional  Features; 

6.  ET/System  Coordination  Features. 

Each  is  discussed  separately  below. 


Computer-Oriented  Features 

Computer-oriented  features  are  aspects  of  instruction  that  can 
only  be  incorporated  into  the  training  program  when  tl  are  is  a  computer 
presenting  some  or  all  of  the  training.  These  features  Cake  advantage 
of  the  computer's  storage  and  processing  capacity.  In  this  category 
our  investigation  assessed  three  features,  any  one  of  which  could 
conceivably  have  been  implemented  independent  of  or  along  with  any 
other  computer  feature:  Computer  Assisted  Instruction,  Artificial 
Intelligence,  and  Computer  Generated  Imagery. 

The  only  computer-oriented  feature  found  among  the  nine  ET 
components  was  CAI.  CAI  is  factual  or  procedural  instruction  presented 
on  a  computer.  The  lessons  or  exercises  reside  in  Che  computer  or  in 
its  storage  media  (e.g.,  disk.  Cape,  videodisc,  slides)  and  instruction 
is  presented  via  some  presentation  media  (e.g.,  video  screen, 
projection,  sound  speaker). 

WWMCCS  was  Che  only  system  Chat  had  a  CAI  capability.  CAI  was 
especially  appropriate  for  WWMCCS  since  this  system  had  multiple 
consoles.  Under  ordinary  conditions,  all  of  the  consoles  are  not 
re<,uired  for  operational  readiness;  thus,  some  of  the  consoles  are 
usually  available  for  training.  In  addition,  Che  physical  environment 
was  conducive  to  CAI  training:  there  was  room  for  texts,  note-taking, 
and  over-Che-shoulder  assistance.  WWMCCS  CAI  was  used  to  present 
procedural  and  factual  information  as  well  as  provide  remedial 
instruction.  Although  WWMCCS  ET  incorporates  situational  simulation 
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capability,  this  was  reported  not  to  be  used  significantly  for 
training. 


Training  Management  Features 

The  features  in  this  category  are  used  by  training  managers  and 
instructors  during  preparation  for  Che  training  session  or  during 
conduct  of  training.  The  features  in  this  category  include: 

1.  Adaptive  Training; 

2.  Scenario  Authoring; 

3.  Bjilt-In  Recordkeeping; 

4.  On-Line  Scenario  Modification. 


Table  1  shows  the  training  management  features  found  in  each  of 
the  systems  reviewed. 


Table  1 


ET  Training  Management  Features 

Built-In  On-Line 

Adaptive  Scenario  Record-  Scenario 

Service/ System _ Training  Authoring  keeping _ Modification 

Army 

Patriot  TPT  X 

Missile  Minder 

Hawk  AN/TPQ-29  X 


Air  Force 

WWMCCS  XXX 

F-15  OBS 

AWACS  X  X 

Navy 

F-14  IFT 

Aegis  ACTS  X  X 

DDG-993  CSTS  X  X 


Group  Totals  161  3 

Adaptive  Training.  Adaptive  training  is  the  use  of  the  ET 
component  to  adjust  the  difficulty  level  of  training  scenarios  or 
lessons  based  upon  the  operator's  performance. 

WWMCCS  was  the  only  system  to  have  adaptive  training,  which  is 
used  only  in  the  CAI  mode.  Trainees  are  automatically  sent  through 
remedial  training  modules  of  instruction  when  they  fail  a  CAI  test. 
WWMCCS  did  not  have  adaptive  capabilities  in  the  simulation  mode. 
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Several  of  the  ET  components  had  scenarios  with  difficulty  levels 
that  could  be  selected  by  the  trainee  or  instructor  prior  to  starting 
the  scenario.  For  example,  the  F-14  IFT  has  preprogrammed  scenarios 
with  assigned  difficulty  levels.  While  this  is  not  adaptive  training 
as  defined  here,  it  does  allow  F-14  crewmembers  or  training  managers  to 
select  scenarios  that  are  best  suited  for  crews'  skill  levels  and 
training  needs. 

Scenario  Authoring.  Scenario  authoring  is  the  capability  to 
create  or  update  scenarios  without  an  equipment  software  update. 

Six  of  the  nine  selected  ET  components  had  scen'jrio  authoring 
capabilities;  the  F-14  IFT,  Missile  Minder,  and  the  F-15  OBS  did  not. 
The  F-14  IFT  does  not  receive  scenario  changes  unless  there  is  a 
modification  Co  the  weapon  system  software.  The  scenarios  are  stored 
in  Read  Only  Memory  (ROM),  which  is  difficult  to  update.  Missile 
Minder  requires  Software  Support  Center  activity  to  develop,  produce, 
and  deliver  new  training  tapes  for  units.  Although  the  F-15  OBS  does 
not  have  a  scenario  authoring  capability,  it  has  the  storage  capacity 
for  a  great  number  of  exercises  coupled  with  random  selection  of 
exercise  presentation. 

Among  the  ET  components  that  have  scenario  authoring  capabi  lity, 
actual  authoring  occurs  at  an  organizational  level  above  the  unit. 
Adjustments  are  made  at  the  unit  level  in  order  to  provide  the 
variability  necessary  for  training  personnel  in  multiple  combat 
environments  or  scenarios.  For  example,  shipboard  systems  like  Aegis 
need  scenarios  that  simulate  weather  and  subsurface  acoustic  conditions 
for  all  of  the  oceans.  Scenario  authoring  is  performed  at  a  level 
above  the  unit  to  ensure  that  all  units  are  provided  with  standardized 
and  meaningful  training.  The  units  provide  input  related  to  necessary 
changes  or  additions  to  existing  scenarios.  WWMCCS  training  is  a 
useful  example  of  how  a  system  like  this  works.  The  WWMCCS  training 
command  at  Reesler  Air  Force  Base  is  responsible  for  producing, 
refining,  and  issuing  the  CAI  tapes  used  by  WWMCCS  personnel.  The  test 
scores  of  the  personnel  using  the  CAI  tapes  are  forwarded  to  the 
training  command,  where  they  are  reviewed  and  any  needed  changes  to  CAI 
lessons  are  identified.  Revised  tapes  are  then  issued  to  WWMCCS  sites. 
Each  WWMCCS  site  is  allowed  to  create  its  own  CAI  tapes  but  not  to 
alter  the  issued  CAI  tapes.  This  provides  unit  flexibility  while 
ensuring  that  the  units  all  have  the  minimum  standard  training  support 
necessary. 

Built-In  Recordkeeping.  This  feature  is  used  to  record  trainee 
performance  during  training  and  over  successive  training  sessions. 

WWMCCS  is  the  only  system  studied  with  a  built-in  recordkeeping 
capability.  WWMCCS  uses  training  results  to  determine  readiness  of  the 
WWMCCS  Information  Network  (WIN).  Each  WWMCCS  unit  toiwarda  CAI  test 
results  to  the  WWMCCS  training  center  at  Keesler  Air  Force  Base  to  be 
used  to  refine  CAI  tape  presentations. 
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On-Line  Scenario  Modification.  This  feature  allows  the  training 
manager  or  instructor  to  alter  a  scenario  while  it  is  running.  In 
addition,  an  on-line  scenario  modification  capability  makes  it  possible 
to  produce  variable  scenario  scripts  as  an  alternative  or  supplement  to 
preprogrammed  scenarios. 

As  indicated  in  Table  1,  three  of  the  nine  selected  ET  components 
have  the  capability  for  on-line  scenario  modifications.  Scripted 
scenarios  can  be  used  for  readiness  evaluations  as  well  as  training. 

For  example,  the  ACTS  ships  use  scenario  modification  control  to 
produce  a  scenario  before  a  readiness  evaluation,  and  run  the  script 
via  ET  during  the  evaluation. 


Automated  Training  Features 

Many  training  functions  normally  performed  manually  can  be 
automated  within  an  ET  component.  The  four  automated  training  features 
examined  during  this  review  are: 

1.  Performance  Feedback; 

2.  Performance  Recording; 

3.  Performance  Measurement; 

4.  Report  Generation. 

Table  2  shows  the  automated  training  features  included  in  each  of 
the  systems  reviewed. 


Table  2 

Automated  ET  Training  Features 

Performance  Performance  Performance  Report 
Serv.  i  ce/System _ Feedback _ Recording  Measuring _ Generation 

Army 

Patriot  TPT 

Missile  Minder  X  X 

Hawk  AN/TPQ-29 

Air  Force 

WWMCCS  XXX 

F-15  OBS 

AW ACS  X 

Navy 

F-14  IFT 

Aegis  ACTS  X  X 

DDG-993  CSTS 


Group  Totals 


4 


2 
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Performance  Feedback.  Performance  feedback  can  take  the  form  of  a 
message  indicating  that  an  incorrect  action  or  decision  has  taken  place 
during  the  training  session,  or  as  detailed  explanation  of  incorrect 
operator  actions  and  what  the  action  should  have  been. 

Only  WWMCCS  has  automated  performance  feedback.  This  capabi  lity 
is  used  only  in  the  CAT  mode  and  not  during  the  simulation  mode. 

Performance  Recording.  This  feature  is  the  extraction  of  operator 
performance  and  scenario  dynamics  during  training.  Performance  data 
are  stored  on  a  storage  medium  and  later  used  for  scenario  replay  or 
reconstruction.  This  reconstruction  can  be  useful  for  detailed 
analysis  and  feedback  to  the  trainee. 

Four  of  the  ET  components  reviewed  have  performance  recording 
capabilities.  The  actual  storage  medium  can  be  portable  (as  with 
AWACS) ,  which  allows  replay  and  reconstruction  at  a  designated 
training-debrief  site.  If  the  storage  medium  is  not  portable,  the 
recorded  data  are  transmitted  to  a  debrief  site  or  replayed  on  the 
actual  equipment.  All  four  ET  components  with  performance  recording 
capability  replay  recorded  performance  data  on  the  actual  equipment  as 
well  as  at  alternate  sites. 

Performance  Measurement.  This  feature  is  an  actual  determination 
by  ET  of  whether  the  operator  has  performed  the  correct  action  or  has 
operated  the  equipment  correctly. 

Of  the  systems  studied,  only  WWMCCS  ET  has  automated  performance 
measurement.  This  capability  is  used  only  in  the  CAI  mode  and  not  in 
the  simulation  mode.  It  should  be  noted  that  behavioral-level 
performance  measurement,  while  ideal  for  many  potential  ET 
applications,  is  only  now  becoming  a  viable  capability.  Hence,  its 
absence  in  the  systems  studied  is  not  surprising. 

Report  Generation.  This  ET  feature  provides  the  training  manager 
with  a  display  or  hardcopy  printout  of  the  process  or  results  of  a 
training  session.  The  report  may  consist  of  raw  data  for  analysis,  or 
the  results  of  the  performance  measurement.  Systems  that  have  only 
printouts  of  target  data  which  do  not  contain  any  operator  performance 
data  (like  the  Patriot)  are  not  considered  to  have  a  report  generation 
capability. 

ACTS  and  Missile  Minder  are  the  only  systems  studied  having  a 
performance  report  generation  capability.  The  reports  produced  by  the 
ET  components  are  limited  to  listing  successful  engagements,  number  of 
missed  attempts,  number  of  attempts,  and  other  summary  data  not 
directly  associated  with  details  of  trainee  performance.  Appendix  B 
contains  a  sample  of  the  Missile  Minder  report.  A  sample  of  the  ACTS 
report  was  not  available. 
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Scenario  ConCrol  Features 


Scenario  control  features  are  aspects  of  instruction  that  allow 
the  training  manager  or  instructor  to  control  the  training  session. 
These  features  take  advantage  of  a  computer's  processing  and  storage 
abilities.  The  features  in  this  category  are: 


1.  Scenario  Freeze; 

2.  Scenario  Playback; 

3.  Scenario  Fast-Forward. 


Table  3  shows  the  scenario  control  features  found  in  each  of  the 
systems  reviewed. 


Table  3 


ET  Scenario  Control  Features 


Service/System 

Scenario 

Freeze 

Scenario 

Playback 

Scenario  Fast 
Forward 

Army 

Patriot  TPT 

Missile  Minder 

Hawk  AN/TPQ-29 

X 

Air  Force 

WWMCCS 

F-i5  DBS 

AW  ACS 

X 

X 

X 

Navy 

F-K  IFT 

Aegis  ACTS 

X 

DDG-993  CSTS 


Group  Totals  131 

Scenario  Freeze.  This  feature  has  two  possible  implementations. 
First,  there  is  manual  freeze,  which  allows  the  training  manager  or 
instructor  to  interrupt  the  scenario  to  assist  the  trainee.  This  is  a 
useful  tool  for  the  instructor.  The  freeze  allows  more  interaction 
between  the  trainee  and  instructor,  without  loss  of  training  time  in 
the  scenario.  In  this  way,  the  trainee  can  receive  guidance  and  even 
receive  detailed  instructions  or  critique  at  critical  points  in  a 
scenario . 

The  second  implementation  of  this  feature  is  automatic  freeze  that 
occurs  when  a  trainee  attempts  to  perform  an  action  that  could  injure 


personnel  or  damage  equipment,  or  which  exceeds  some  established 
parameters  of  the  training  scenario.  After  freezing  the  scenario  at 
the  point  at  which  an  error  of  this  type  occurs,  an  instructor  can  be 
called,  and  an  opportunity  made  to  explain  the  factors  associated  with 
the  incorrect  action.  Automatic  freeze  allows  instructors  (if  any)  to 
perform  other  duties  during  training,  rather  than  requiring  constant 
over** the- shoulder  observation  to  catch  such  occurrences. 

Of  the  systems  studied,  AWACS  has  the  only  ET  component  capable  of 
freezing  a  scenario  during  training  and  resuming  Che  scenario  from  the 
same  point . 

Scenario  Playback.  Scenario  playback  is  the  capability  to  provide 
scenario  replay  including  the  actions  taken  by  the  trainee  in  response 
to  the  scenario  situation  and  dynamics.  Scenario  playback  can  occur  on 
the  prime  equipment  or  at  a  designated  training  debrief  site.  In  order 
to  replay  a  scenario  in  a  location  other  than  the  prime  equipment,  it 
is  necessary  to  record  the  data  on  a  portable  medium  or  to  transmit  the 
data  to  the  other  equipment. 

Missile  Minder  ET,  AWACS  ET,  and  ACTS  each  has  playback 
capability;  all  three  are  capable  of  playback  on  the  actual  equipment 
or  at  a  training  debriefing  site. 

Scenario  Fast-Forward.  This  feature  serves  two  functions.  First, 
it  enables  the  instructor  or  trainee  to  start  a  scenario  at  a  point 
other  than  the  beginning.  Second,  it  is  useful  during  playback  for 
skipping  over  insignificant  or  unneeded  parts  of  the  scenario.  This  is 
useful  when  a  trainee  needs  to  practice  particular  sequences  such  as 
responding  to  a  mass  coordinated  attack.  This  feature  supports  ET  for 
part-scenario  training  or  part-task  training. 

AWACS  is  the  only  system  with  a  scenario  fast-forward  capability. 
This  capability  is  used  by  AWACS  crews  to  enter  scenarios  at  selected 
points . 


Instructional  Features 


These  are  features  that  can  assist  the  trainee  or  instructor  in 
using  the  ET  component.  Two  instructional  features  were  considered  in 
this  review: 


1.  Cemcnstrat ion  mode; 

2.  User-help  facility. 

These  features  were  not  found  on  any  of  the  nine  ET  components 
reviewed. 
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ET/System  Coordinatior.  Features 


How  the  ET  component  is  configured  and  how  it  relates  to  the 
operational  equipment  are  of  importance  to  ET  users.  The  coordination 
features  included  in  this  review  are: 

1.  Whether  the  ET  is  a  "strap  on"  or  was  completely  integrated 
into  the  prime  equipment; 

2.  Whether  ET  is  used  in  an  on-line  or  off-line  mode; 

3.  Whether  ET  supports  coordinated  training  with  other  similar 
or  dissimilar  types  of  systems. 

Table  4  shows  the  ET/system  coordination  features  found  for  each 
of  the  systems  reviewed. 


Table  4 

ET/ System  Coordination  Features 


Coordi¬ 

nated 

Service/System _ Integrated  Strap-On  Off-Line  On-Line  Training 


Army 

Patriot  TPT  X 
Missile  Minder  X 
Hawk  AN/TPQ-29 

Air  Force 

WWMCCS  X 
F-15  DBS  X 
AW ACS  X 

Navy 

F-14  IFT  X 
Aegis  ACTS  X 
DDG-993  CSTS  X 


X  X 

XXX 
X  X 


XXX 

X 

XXX 


X 

XXX 

X 


Group  Totals  8  1765 

Integrated/ Strap-On.  Integrated  means  that  the  ET  component  does 
not  require  a  separate  physical  device  to  be  connected  to  the  prime 
system.  An  integrated  ET  component  can  have  independent  processors, 
displays,  and  Coutiols  (a»  the  CSTS  does),  or  it  can  use  processors, 
controls,  and  displays  of  the  prime  system. 


Eight  of  the  EX  cooponents  were  designed  as  integrated  subsystems 
within  the  prime  equipment.  The  Hawk  missile  system  was  the  only 
weapon  system  with  a  strap-on  EX  component  (AN/XPQ-29).  There  are 
problems  associated  with  the  strap-on  nature  of  the  AN/XPQ-29.  The 
most  significant  problems  are  related  to  the  time  required  to  hook  up 
and  remove  the  strap-on  component.  In  this  case,  the  strap-on 
component  was  reported  to  have  the  benefit  of  being  less  costly  than 
adding  an  integral  EX  component,  after  the  weapon  system  had  been 
deployed. 

Off-Line  Training.  During  off-line  training,  the  prime  equipment 
is  removed  from  operational  use  while  training  is  conducted. 

Seven  of  the  ET  components  are  capable  of  training  in  an  off-line 
mode.  It  appears  to  be  a  useful  mode,  as  long  as  the  actual  equipment 
is  available  for  off-line  training.  However,  some  weapon  systems 
reviewed  have  such  high  readiness  requirements  that  prime  equipment  is 
not  available  for  off-line  training.  When  State  of  Readiness  (SOR) 
requirements  prohibit  the  use  of  the  equipment  in  an  off-line  mode,  an 
on-line  component  may  be  necessary. 

On-Line  Training.  During  this  type  of  training,  the  weapon  system 
is  able  to  perform  its  operational  mission  while  training  is  conducted. 
Three  methods  have  been  identified  for  conducting  on-line  training. 

The  first  method  is  used  when  there  is  more  than  one  operator  station. 
Selected  stations  are  used  for  trai’'ing  while  the  other  stations  are 
used  for  performing  operational  dut..*s.  A  second  way  to  conduct 
on-line  training  is  to  have  simulated  targets  or  other  stimuli 
overlaying  the  operational  environment.  The  third  method  is  to  employ 
an  "automatic  alert"  system  that  stops  the  training  session  and 
automatically  reconfigures  the  weapon  system  to  an  operational  mode 
when  certain  conditions  are  met. 

Six  of  the  ET  components  reviewed  are  capable  of  providing  on-line 
training.  WWMCCS  and  ACTS  use  multiple  operator  stations;  during 
on-line  training  one  or  more  stations  are  used  for  training,  while 
operational  duties  are  performed  at  other  stations.  AWACS  is  the  only 
ET  component  reviewed  that  has  an  "automatic  shutoff"  capability  to 
suspend  training  when  specified  conditions  were  met.  No  ET  component 
reviewed  uses  a  combination  of  simulation  and  actual  operational 
utilization  ("simulated  over  live"). 

Coordinated  Training.  Training  with  other  weapon  systems  and 
units  is  coordinated  training.  The  method  used  for  coordinated 
training  by  the  ET  components  reviewed  is  to  send  simulated  targets  to 
other  weapon  systems  over  a  comaunications  link. 

Five  of  the  weapon  systems  reviewed  have  the  capability  to  provide 
simulated  targets  for  other  weapon  systems.  The  ET  components  use 
communications  links  to  send  targets  to  other  systems,  to  allow 
operators  of  separate  weapon  systems  to  interact,  and  to  coordinate 
exercises  with  other  units.  This  allows  several  weapon  systems  to 
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train  against  the  same  targets  at  the  same  time.  In  addition,  these 
five  weapon  systems  are  capable  of  providing  simulated  targets  for 
physically  separated  units  of  the  same  weapon  system.  Coordinated 
training  appears  to  be  useful  for  training  personnel  who  are 
responsible  for  coordinating  multiple  weapon  systems  during  a  mission. 
This  type  of  training  is  especially  applicable  to  command,  control,  and 
cooununication  systems,  since  their  mission  is  to  coordinate  multiple 
weapon  i ystems.  AWACS  and  Missile  Minder  are  examples  of  such 
systems. 


Impact  Factors  Affecting  the  Use  of  ET 


Logistical  Impact  Factors 

ET  can  have  an  impact  on  the  logistics  of  a  system.  Such  effects 
can  coutribute  to  both  positive  and  negative  attitudes  toward  ET  and 
the  use  of  ET.  The  categories  impacts  evaluated  are: 

1.  Effects  on  equipment  differences; 

2.  Effects  on  parts  requirements; 

3.  Effects  on  maintenance  requirements; 

4.  Effects  on  equipment  wear. 

The  presence  of  ET  has  reported  negative  logistical  impacts  on 
only  two  of  the  systems  studied;  Hawk  used  with  AN/TPQ-29,  and  DDG-993 
CSTS.  In  this  section,  the  logistical  impact  factors  affecting  the  use 
of  these  two  systems  is  discussed. 

Logistical  Impact  Factors  Affecting  the  Use  of  the  Hawk  With 
AN/TPQ-29.  The  AN/TPQ-29  is  a  strap-on  ET  component  with  many  unique 
parts  and  operating  characteristics.  Introducing  this  device  is 
reported  to  have  resulted  in  an  increase  in  the  number  of  parts 
required  in  inventory,  in  maintenance  requirements,  and  in  additional 
training  needed  due  to  equipment  uniqueness.  The  difficulties 
encountered  during  hooking  up  the  AN/TPQ-29  have  increased  wear  on 
Hawk  prime  system  components.  The  major  problem  is  reported  to  he  with 
personnel  bending  cannon  plug  pins  when  hooking  up  the  AN/TPQ-29.  The 
damaged  plugs  must  be  replaced  before  a  Hawk  weapon  system  can  again  be 
connected  to  the  AN/TPQ-29. 

Logistical  Impact  Factors  Affecting  the  Use  of  the  DDG-993  CSTS. 
The  CSTS  is  a  former  strap-on  component  that  was  integrated  into  the 
DDG-993  ships.  The  unique  equipment  and  operating  characteristics  of 
the  CSTS  are  reported  to  have  increased  the  number  of  parts  that  must 
be  carried  in  the  ship's  inventory.  The  presence  of  the  CSTS  has  also 
reportedly  increased  maintenance  requirements  for  the  ship  overall. 
Equipment  differences  have  had  no  significant  negative  impacts  on 
training  requirements  for  the  ships'  crews,  since  CSTS  is  menu-driven 
and  very  user-friendly.  The  CSTS  was  developed  specifically  to  relieve 
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Che  schools  of  personnel-replacement  requirements  they  were  not  capable 
of  meeting. 


Time  Impact  Factors 

The  four  time  impact  factors  examined  during  the  review  are: 

1.  Overall  System  Downtime; 

2.  Availability  of  Trainees  for  Training; 

3.  Availability  of  Equipment  for  Training; 

4.  Life-Cycle  Phase  During  Which  the  ET  Component  was 
Developed. 

Table  5  shows  the  time  impact  factor  ratings  for  each  of  the 
weapon  systems. 


Table  5 


ET  Time  Impact  Factors 


System 

Trainee 

Equipment 

Time  of 

Service/System 

Downtime 

Availability 

Availability 

Developmei 

Array 

Patriot  TPT 

L 

A 

A 

B 

Missile  Minder 

L 

I 

I 

B 

Hawk  AN/TPQ-29 

H 

I 

I 

F 

Air  Force 

WWMCtS 

L 

A 

A 

F 

F-15  OBS 

L 

A 

A 

F 

AWACS 

L 

S 

S 

B 

Navy 

F-14  IFT 

L 

A 

A 

B 

Aegis  ACTS 

L 

A 

A 

B 

DDG-993  CSTS 

L 

A 

A 

F 

Group  Totals 

L“8 

1-2 

1-2 

F-4 

H»1 

S-1 

S-1 

B-5 

A-6 

A-6 

Table  Codes: 

L  Low,  infrequent  or  no  equipment  failures 
M  Moderate,  frequent  equipment  failures. 

H  High,  consistently  failing  equipment, 

A  Always  available  (no  restrictions). 

S  Sometimes  available  (at  least  once  r  week). 

I  Infrequently  available  (less  than  3  times  per  month). 
B  Before  initial  weapon  system  delivery. 

F  Following  initial  weapons  system  delivery. 


fQfPfju  $*4  1*4  to  fQ  fO  f*4 


Overall  System  Downtime.  Documents  reviewed  indicate  that 
AN/TPQ-29  has  had  a  long-standing  maintainability  problem.  There  are 
long  periods  of  downtime,  when  the  equipment  is  undergoing  repair 
instead  of  being  used  for  ET.  All  of  the  other  systems  surveyed  have 
low  equipment  failure  rates.  A  low  failure  rate  means  that  the 
equipment  is  normally  ready  to  present  ET,  within  the  constraints  of 
operational  and  personnel  requirements. 

Availability  of  the  Trainees  and  Equipment  for  Training.  In  six 
of  the  nine  systems  reviewed,  personnel  and  equipment  are  scheduled  for 
training  (or  train  with  a  non-scheduled  frequency  of)  at  least  once  a 
week.  AWACS  personnel  and  equipment  are  slightly  restricted  in  using 
ET,  due  to  readiness  requirements  and  flight  demands  of  AWACS  units. 
Missile  Minder  and  Hawk  personnel  and  equipment  are  restricted  even 
more  by  the  SOR  requirements  of  the  units.  However,  Missile  Minder  ET 
cannot  be  run  in  the  on-line  mode,  since  ET-generated  targets  enter  the 
communications  net,  and  may  be  perceived  by  the  Communication  Report 
Center  (CRC)  as  real  targets. 

Life-Cycle  Phase  During  Which  the  ET  Component  was  Developed.  The 
life-cycle  phase  in  which  ET  is  developed  can  have  a  significant  impact 
on  the  characteristics  and  value  of  the  ET  component. 

Among  the  systems  reviewed,  the  ET  component  was  developed 
following  initial  delivery  for  four  of  the  systems:  AN/TPQ-29,  WWMCCS, 
F-15  OBS,  and  DDG-993  CSTS.  For  the  remaining  five  systems,  ET  was 
developed  concurrently  with  prime  system  development.  In  the  following 
paragraphs,  the  effects  of  ET  development  before  and  after  weapon 
system  delivery  are  discussed. 

Four  of  the  ET  components  studied  were  developed  after  the  prime 
system  had  been  initially  delivered.  The  development  of  an  ET 
component  after  system  delivery  does  not  necessarily  result  in  an 
ineffective  training  element,  but  appears  to  increase  the  cost  of  the 
ET  component.  Although  specific  data  on  segregated  costs  of  ET 
components  was  not  available,  examination  of  the  development  of  the  ET 
components  and  the  changes  undergone  reveals  some  possible  links  to 
higher  ET  costs  associated  with  post-fielding  with  development  of  ET. 
Another  possible  impact  of  post-fielding  development  is  that  ET  may 
have  to  be  designed  as  a  strap-on  component. 

The  AN/TPQ-29  was  developed  about  ten  years  after  the  Hawk  missile 
system  was  first  delivered.  The  main  factors  (weapon  system 
reliability  and  SOR  requirements)  affecting  the  use  of  the  AN/TPQ-29 
do  not  appear  to  be  direct  results  of  late  development.  It  is  not 
clear  whether  the  AN/TPQ-29  was  designed  as  a  strap-on  component 
because  of  its  late  development,  but  if  that  is  the  case,  the 
difficulties  associated  with  the  hookup  of  ET,  which  cause  many 
problems,  may  be  related  co  the  late  development  of  ET,  as  well  as  to 
poor  design. 


Tne  DDG-993  CSTS  was  developed  in  two  stages.  In  its  first  stage, 
it  was  called  the  Combat  System  Test  Set,  and  was  a  strap-on  pier-side 


training  and  testing  device.  The  first-generation  CSTS  orovided 
effective  training,  but  it  was  not  considered  a  practical  trainer 
because  it  took  a  full  day  to  set  up  and  check  out  the  device  and 
several  hours  to  disconnect.  The  second  generation,  now  called  the 
Combat  Simulation  Test  System,  has  many  improved  and  added 
capabilities.  The  biggest  improvement  is  that  it  is  integrated  into 
the  ship,  requiring  no  hookup  and  less  setup.  Although  no  specific 
cost  data  are  available  on  the  CSTS,  it  appears  chat  adding  an  ET 
component  in  this  fashion  is  costlier  than  designing  it  as  an 
integrated  component  during  earlier  stages  of  Che  life  cycle.  The  CSTS 
appears  Co  be  a  satisfactory  ET  component,  but  development  costs 
associated  with  retrofit  of  Che  second  generation  CSTS  are  reported  to 
have  been  high.  It  should  be  noted  chat  Che  Navy  was  forced  to 
purchase  the  DDG-993  class  destroyers  after  an  aborted  Foreign  Military 
Sale  (to  Iran),  which  is  why  the  CSTS  was  developed  in  this  manner. 

There  were  no  problems  reported  to  be  associated  with  Che  WWMCCS 
ET  component  resulting  from  its  stage  of  development.  Since  WWMCCS  ET 
is  completely  a  software  implementation,  this  is  not  particularly 
surprising.  It  is  not  possibie  Co  evaluate  the  impact  of  the  phase  of 
development  of  the  F-15  OBS,  because  it  is  not  deployed  in  active 
squadrons . 

The  remaining  five  ET  components  evaluated  during  this  review  were 
all  developed  in  parallel  with  the  prime  equipment.  The  main  benefit 
of  this  approach  appears  to  be  that  all  are  integrated  ET  components. 
The  lack  of  ET  decision  and  design  models  is  apparent,  because  none  of 
Che  ET  components  of  these  systems  fully  train  any  Casks;  however, 
school  training  is  fully  structured,  and  training  devices  have  been 
developed  to  support  hands-on  training  for  each  of  the  systems.  The 
training  data  from  the  schools  and  stand-alone  training  devices  was 
reportedly  not  utilized  for  the  design  of  any  of  the  ET  components. 
Apparently,  ET  design  and  development  was  left  entirely  to  system 
engineers,  with  few  significant  inputs  from  training  specialists. 


Operating  Impact  Factors 

The  operability  of  a  system's  ET  component  and  of  Che  system 
itself  can  have  an  impact  on  the  use  of  ET.  The  operating  impact 
factors  examined  in  the  review  are: 

1.  Ease  of  Start-up  and  Shut  Down; 

2.  Overall  System  Operating  Ease; 

3.  Overall  ET  Component  Operating  Ease; 

4.  Relative  Length  of  Start-up  or  Shut  Down  for  the  ET. 

Table  6  shows  the  operating  impact  factor  ratings  for  each  of  the 
weapon  systems  reviewed. 
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Table  6 


Operating  Impact  Factors 


ET  ET  System  ET  ET  ET 

Start-un  Shut  Doun  Oper.  Oper.  Start-up  Shut  Down 

Service/System _ Ease _ Ease _ Ease  Ease  Time _ Time 


Army 


Patriot  TFT 

E 

E 

E 

E 

L 

L 

Missile  Minder 

E 

E 

E 

E 

L 

L 

Hawk  AN/TPQ-29 

D 

D 

0 

0 

H 

R 

Air  Force 

WWMCCS 

E 

E 

E 

E 

L 

L 

F-15  OBS 

E 

E 

D 

E 

L 

L 

AWACS 

E 

E 

0 

E 

H 

L 

Navy 

F-14  IFT 

0 

E 

D 

E 

L 

L 

Aegis  ACTS 

E 

E 

0 

E 

M 

L 

DDG-993  CSTS 

0 

0 

0 

E 

M 

M 

Group  Totals  E-6 

E-7 

E-3 

E-8 

L-5 

L-7 

0-2 

0-1 

0-4 

0-1 

M-2 

M-2 

D-1 

D-1 

D-2 

H-2 

H-1 

Table  Codes: 

E  Easy  to  operate 

L 

Low  time  to 

start  up 

or 

0  Moderately  difficult 

to  operate 

shut  down 

D  Difficult  to  opeiate 

M 

Medium  time 
shut  down 

to  start 

up  or 

H 

High  time  to  start  up  or 

shut  down 

Ease  of  Start-up  and 

Shut  Down. 

Start- 

-up  and  shut 

down  t ime  i s 

the  time  to  load  and  configure  ET  and  the  time  to  go  from  the  ET  mode 
to  the  operational  mode,  respectively. 

Six  of  the  ET  components  were  rated  as  easy  to  start-up,  since 
start-up  required  only  one  switch  action  and  no  data  entry.  Two  ET 
components  were  rated  "medium"  in  start-up  ease  because  they  required 
more  than  one  switch  action  and  some  minimal  data  entry.  The  AN/TPQ-29 
is  considered  difficult  to  start-up,  because  hooking  up  the  ET 
component  to  the  Hawk  system  is  difficult  and  because  the  Hawk  system 
itself  must  be  set  up  before  the  AN/TPQ-29  can  be  used. 

The  uirriculLy  y£  ahufcuing  down  the  ET  component  was  almost  always 
the  same  as  the  difficulty  of  start-up;  however,  shut  down  seldom 
requires  data  entry.  The  CSTS  was  given  a  "medium"  rating  for  shut 
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dovm  ease  because  it  has  many  mode  switches;  one  at  the  TCC  and  one  at 
each  station  simulated  by  the  CSTS.  The  AN/TPQ-29  was  rated  difficult 
to  shut  down  because  it  is  as  difficult  to  disengage  the  AN/TPQ-29  from 
the  Hawk  system  as  it  is  to  engage  it.  The  Hawk  equipment  also  must  be 
retuned  and  adjusted  after  the  AN/TPQ-29  has  been  used. 

Overa.'-l  System  Operating  Ease.  The  system  operating  ease  rating 
depends  on  the  system's  sophistication,  training  requirements,  and 
user-friendliness.  Three  systems  were  rated  as  relatively  easy  to 
operate,  because  of  their  cue/menu  responses  and  automated  data 
processing  made  the  system  easy  to  learn  and  operate.  Four  systems 
required  additional  training  to  utilize  ET  and  placed  additional 
demands  on  the  operators.  Thus,  they  were  given  "moderately  difficult" 
operating-ease  ratings.  The  F-15  and  F-14  were  considered  difficult  to 
operate,  since  it  takes  extensive  training  to  prepare  crews  to  operate 
these  systems. 

Overall  ET  Component  Operating  Ease.  When  it  came  to  the  ease  of 
operating  the  ET  component,  only  the  AN/TPQ-29  was  rated  as  difficult 
to  operate.  The  AN/TPQ-29  ET  component  has  displays  and  controls  that 
are  substantially  different  from  those  of  the  prime  system.  This 
results  in  additional  training  requirements.  A  lack  of  user- 
friendliness  in  the  human-system  interface  reportedly  further  increased 
the  difficulty  of  using  AN/TPQ-29  ET.  All  of  the  other  ET  components 
were  rated  as  easy  to  operate,  with  user-friendly  cues,  alerts,  and 
menus . 

Relative  Length  of  Start-up  or  Shut  Down  for  the  ET.  The  ET 
start-up  time  is  not  critical  to  mission  readiness,  but  does  have  an 
impact  on  the  use  of  ET  Five  of  the  systems  have  short  start-up 
times,  requiring  one  minute  or  less  to  initialize  ET.  Two  systems  have 
moderate  start-up  times  requiring  more  than  one  minute,  but  less  than 
five  minutes  to  initialize  ET.  Two  systems  have  high  start-up  times, 
requiring  five  minutes  or  more  to  initialize  ET. 

ET  shut  down  time  critical  to  mission  readiness,  since  when  a 
unit  is  called  upon  to  fulfill  an  operational  requirement,  its  response 
time  may  be  critical  to  the  successful  completion  of  a  mission.  If  an 
operational  need  arises  while  the  unit  is  engaged  in  ET,  the  faster  the 
unit  can  switch  from  an  ET  mode  to  an  operational  mode,  the  quicker 
their  response  time  will  be. 

Seven  systems  have  ET  shut  down  times  of  one  minute  or  less. 

AWACS  is  the  only  system  with  an  automatic  ST  shut  down.  The  DDG-993 
CSTS  is  the  ouly  system  with  a  "medium"  time  (less  than  five  minutes, 
but  more  than  one  minute)  for  ET  shut  down.  The  AN/TPQ-29  is  the  only 
system  with  a  long  ET  shut  down  time. 


26 


ET  Training  Functions 


Task  Categories  Trained 

Training  in  three  task  categories  was  examined  during  the  review: 
equipment  operation  tasks,  team  operation  tasks,  and  maintenance 
tasks. 


Table  7  shows  the  task  categories  trained  in  the  systems  that  were 
reviewed. 

Table  7 

Task  Categories  Trained 
Equipment  Team 

Operation  Operation  Maintenance 

Service/System _ Tasks _ Tasks _ Tasks _ 


Army 

Patriot  TPT  X 
Missile  Minder  X 
Hawk  AN/TPQ-29  X 

Air  Force 

WWMCCS  X 
F-15  OBS  X 
AWACS  X 


X 

X 

X 


X 

X 


Navy 

F-14  IFT 
Aegis  ACTS 
DDG-993  CSTS 


X 

X 

X 


X 

X 

X 


Group  Totals  9  8  0 

Equipment  Operation  Tasks.  In  equipment  operation  tasks, 
operators  are  required  to  respond  to  stimuli  presented  by  ET  as  they 
would  during  actual  operational  use  of  the  equipment. 

All  nine  of  the  ET  components  reviewed  are  used  to  train  equipment 
operation  tasks. 

Team  Operation  Tasks.  In  team  tasks,  stimuli  are  presented  that 
require  interaction  between  two  or  more  operators  on  the  same  weapon 
system  or  between  two  or  more  operators  on  separate  weapon  systems,  ET 
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is  used  to  provide  training  that  requires  the  operators  to  interact 
effectively  in  order  to  successfully  complete  the  mission. 

Eight  of  the  ET  components  reviewed  are  capable  of  training  team 
tasks.  The  F-15  OBS  is  the  only  system  that  cannot  train  team  tasks. 
This  is  due  to  the  fact  that  the  system  is  not  capable  of  providing 
simulated  targets  for  other  aircraft  or  for  ground  forces,  and  because 
other  aircraft  are  not  allowed  in  the  same  training  airspace  with  an 
aircraft  using  the  OBS  (to  prevent  possible  collisions  during 
maneuvers) . 

The  Aegis  defense  system  and  the  combat  system  on  the  DDG-993 
class  destroyer  are  both  large  systems  that  require  coordination  of 
weapon  systems  with  multiple  operator  stations.  The  ET  on  these 
systems  provides  training  in  those  aspects  of  team  operator 
performance.  Only  the  AWACS,  Aegis,  and  Missile  Minder  ET  components 
are  used  for  team  training  with  other  (dissimilar)  systems. 

Maintenance  Tasks.  None  of  the  systems'  ET  components  currently 
train  maintenance  tasks.  However,  the  addition  of  this  capability  is 
reportedly  planned  for  several  ET  components. 


Training  Uses 

The  four  training  uses  of  ET  examined  during  the  review  are: 

1.  Individual  Training; 

2.  Team  Training; 

3.  Preparatory  Exercises; 

k.  Readiness  Evaluations. 

In  general,  the  way  in  which  the  units  use  ET  appeared  to  be 
limited  more  by  the  command's  desired  use  of  ET  than  by  the 
capabilities  of  the  ET  component.  Table  8  shows  the  training  uses  of 
each  of  the  ET  components. 
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Table  8 


Training  Uses  of  ET 

Individual  Team  Preparatory  Readiness 

Service/System  Training  Training  Exercises  Evaluation 


Army 

Patriot  TPT  % 

Missile  Minder 

Hawk  AN/TPQ-29  X 

Air  Force 

WWMCCS  X 

F-15  0B8  X 

AWACS  X 

Navy 

F-14  IFT  X 

Aegis  ACTS  X 

DDG-993  CSTS  X 


X  X 

XXX 

X 


X  X 

X  X 


X  X 

XXX 
X  X 


Group  Totals  88  63 

Individual  Training.  Eight  of  the  ET  components  are  used  for 
individual  training  in  which  one  operator  is  trained  alone.  Missile 
Minder  ET  is  the  only  ET  component  that  was  not  used  for  individual 
training,  although  it  has  this  capability. 

Team  Training.  Eight  of  the  ET  components  are  used  for  team 
training.  As  mentioned  above,  only  the  F-15  OBS  is  not  used  for  team 
training. 

An  example  of  the  usefulness  of  team  training  comes  from  the  CG-47 
(Aegis)  class  cruisers.  Aegis  is  a  highly  sophisticated  system,  with 
an  array  of  sensors  operated  by  numerous  personnel  with  different 
occupational  specialties.  ACTS  supports  the  training  of  team  tasks  for 
the  various  sonar,  radar,  and  weapon  control  station  operators  by 
providing  simulated  air,  surface,  and  subsurface  targets.  ACTS  can 
also  transmit  simulated  targets  to  other  participating  units,  such  as 
helicopters  or  other  ships,  so  that  Aegis  operators  can  practice 
coordinating  target  prosecution. 

Preparatory  Exercises.  Preparatory  exercises  are  normally 
large-scale  exercises  scheduled  prior  to  readiness  inspections. 

Six  of  the  ET  components  are  used  in  preparatory  exercises.  In 
fact,  preparatory  exercises  are  a  majoi  use  of  Missile  Hinder  ET. 

Readiness  Evaluations.  Readiness  evaluations  are  planned 
exercises  that  are  conducted  to  evaluate  unit  readiness. 
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As  shown  in  Table  8,  only  three  of  the  ET  components  reviewed  are 
used  during  readiness  evaluations. 


Types  of  ET  Training 

The  three  types  of  training  examined  during  the  review  were: 

1.  Full  Mission  Scenario; 

2.  Part  Mission  Scenario; 

3.  Part-Task  Training. 


Table  9  shows  the  types  of  ET  training  conducted  on  each  of  the  ET 
components  reviewed. 


Table  9 


Types  of  ET  Training 
Full  Mission  Part  Mission 


Scenario 

Service/System _ Training 


Army 

Patriot  TPT  X 

Missile  Minder  X 

Hawk  AN/TPq-29  X 

Air  Force 

WWMCCS  X 

F-15  OBS 

AWACS  X 

Navy 

F-14  IFT 

Aegis  ACTS  X 

DDG-993  CSTS  X 


Scenario  Part-Task 

Training _  Training 

X 

X 

X 


X 

X 

X 


X 

X 

X 


Group  Totals  7  81 

Full  Mission  Scenario.  ET  provides  full  mission  scenario  training 
by  stimulating  the  equipment  for  all  tasks  performed  during  a  mission 
or  evolution. 

Full  mission  scenario  training  is  provided  by  seven  of  the  ET 
components  reviewed. 

Part  Mission  Scenario.  The  ET  components  reviewed  provided  part 
scenario  training  by  simulating  the  equipment  for  part  of  the  tasks 
required  for  successful  mission  accomplishment. 
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Eight  of  Che  ET  compoaenCs  provide  part  mission  scenario  training. 
This  type  of  training  is  used  when  there  is  not  enough  time  Co  run 
full  mission  scenarios,  or  when  operators  require  training  in  a 
specific  part  of  a  mission.  ET  accommodates  this  type  of  training  with 
on-line  scenario  modification  or  scenario  fast-forward  features.  T 
of  the  ET  components  (F-14  IFT  and  F-15  OBS)  are  only  capable  of 
training  part-tasks,  because  they  use  preprogrammed  scenario.  *bich  are 
not  modifiable  Co  incorporate  all  mission  Casks.  The  F-14  IFT  ...  .  ly 

capable  of  training  missile  firing  Casks,  and  Che  F-i5  OBS  can  only 
Crain  aerial  gunnery  and  ground  attack  Casks. 

Part-Task  Training.  This  type  of  training  includes  training  of 
only  particular  tasks  or  parts  of  Casks. 

WWMCCS  CAI  is  Che  only  ET  component  reviewed  Chat  specifically 
provides  this  type  of  training.  Part-task  training  on  WWMCCS  CAI  is 
limited  to  Cask  knowledges  rather  Chan  actual  skills.  Part-task 
training  is  usually  thought  of  as  a  pare  of  initial  skills 
acquisition.  Thus,  it  is  not  commonly  conducted  at  the  unit  level.  It 
was  noC  therefore  surprising  chat  only  one  of  the  ET  components  in  this 
review  provides  this  type  of  training. 


Obiective  Categories  Trained 

An  analysis  of  the  training  objectives  provided  by  each  of  the  ET 
components  was  not  possible. 


Levels  of  Training 

Training  objectives  have  prescribed  conditions  and  standards  Chat 
state  how  they  should  be  trained  and  Co  what  degree  they  should  be 
trained.  The  standard,  or  performance  level,  of  an  objective  is 
usually  Che  minimum  acceptable  level  of  performance.  The  training 
levels  considered  during  analysis  include: 

1.  Skill  Acquisition  Training; 

2.  Sustainment  Training; 

3.  Full  Mastery  Training. 

Table  10  shows  the  training  levels  for  each  of  the  ET  components 
reviewed. 
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Ta»-le  10 


Training  Levels  for  ET 


Skill 

Acquisition  Sustainment  Full  Mastery 
Service/  System _ Training _ Training _ Training 


Army 

Patriot  TPT 
Missile  Minder 
Hawk  AN/TPQ-29 


X 

X 


Air  Force 
WWMCCS 
F-15  OBS 
AWACS 


X 

X 


Navy 

F-14  IFT 
Aegis  ACTS 
DDG-993  CSTS 


X 

X 


X 

X 

X 


X 


X 


Group  Totals  49  2 

Skill  Acquisition  Training.  Acquisition  training  is  used  to 
acquire  completely  new  skills  and  knowledge. 

ET  is  not  commonly  used  for  initial  training  among  the  ET 
components  reviewed.  WVmcCS  is  used  for  training  new  knowledges .  but 
is  not  used  to  train  skills .  The  AN/TPQ-29,  ACTS,  and  CSTS  are  used  to 
train  some  new  skills  only  in  cases  when  needed  to  redress  inadequacies 
in  school  training. 

Sustainment  Training.  This  type  of  training  is  used  to  maintain 
perishable,  critical  skills  and  knowledges  at  criterion  performance 
level,  after  initial  skill  acquisition. 

All  of  the  ET  components  reviewed  provide  sustainment  training. 

In  fact,  sustainment  training  is  the  principal  use  of  the  nine  ET 
components . 

Full  Mastery  Training.  In  full  mastery  training,  personnel  are 
trained  to  a  level  that  exceeds  the  minimum  criterion  level  of 
performance.  This  type  of  training  enables  acceptably  proficient 
operators  to  become  expert  operators,  and  provides  those  already  expert 
with  opportunities  to  sharpen  cheir  skills. 

AWACS  and  ACTS  are  the  only  ET  components  reviewed  that  are 
capable  of  full  mastery  training.  With  ACTS,  this  capability  is 
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utilized  to  upgrade  the  skills  of  already  proficient  personnel. 
Although  AWACS  has  this  capability,  it  is  seldom  used,  due  to  mission 
performance  requirements  in  flight. 
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SECTION  4 


DISCUSSION 


The  data  presented  in  Section  3  of  this  report  were  further 
considered,  along  with  anecdotal  and  interview  data  from  the  data 
collection  effort,  to  attempt  to  derive  general  findings  which  may 
serve  as  lessons  learned  or  indications  for  development  of  future  ET 
components.  This  section  discusses  such  general  findings  that  follow 
from  the  data.  Five  general  topics  are  discussed  here.  They  are: 

1.  General  Observations  on  Embedded  Training; 

2.  ET  Development  and  the  System  Development  Process; 

3.  ET  Utilization  and  Relationships  with  System  Constraints; 

4.  Training  Characteristics  and  ET;  an''* 

5.  ET  Interactions  with  Logistics. 


General  Observations  on  Embedded  Training 


The  available  data,  especially  anecdotal  data  from  interviews, 
strongly  suggest  that  the  training  provided  by  the  nine  ET  components 
examined  in  this  study  was  perceived  as  of  value.  While  each  of  the  ET 
components  had  both  strong  and  weak  characteristics,  each  also  provided 
training  which  was  clearly  needed,  and  which  might  have  been  more 
difficult  to  obtain  in  other  fashions  than  ET.  The  ET  components 
studied  are  generally  used  in  a  relatively  systematic  fashion  to 
provide  task  practice  for  which  each  component  is  suitable.  There  is 
no  programmatic  indication  that  any  of  the  ET  components  was  a  "nice  to 
have"  feature  of  the  system  (with  the  possible  exception  of  the  F-15 
OBS,  which  is  not  a  deployed  system  component).  However,  there  is 
little  ir,aication  that  any  of  the  ET  components  is  responsive  to  a 
thoroughly  wo/ked-uiit  set  of  training  requirements.  Likewise,  there  is 
no  specific  indication  that  any  of  the  ET  components  was  designed  in 
the.  context  of  a  "total  training  system"  supporting  the  prime  item 
system  with  wiiirh  each  is  associated. 

The  ET  components  studied  almost  universally  lack  modem,  advanced 
training  support  and  training  management  characteristics  commonly 
associated  with  state  of  the  art  training  devices  and  computer-based 
training.  Given  the  time  at  which  each  of  the  ET  components  was 
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developed,  and  the  fact  that  the  ET  components  appear  to  have  oaen 
considered  separate  from  the  total  training  system  approach,  this 
finding  is  not  surprising.  Even  without  these  advanced  features, 
however,  the  ET  components  are  able  to  provide  at  least  some  level  of 
effective  stimulation  to  support  task  practice.  This  suggests  that 
even  ET  components  of  very  low  levels  of  sophistication  can  provide 
some  needed  training  as  an  alternative  to  other  approaches. 

Especially  in  cases  where  dedicated  training  devices  are 
unavailable  or  difficult  to  access  by  unit-level  personnel,  "something 
is  better  chan  nothing."  Given  Che  probable  complexities  and 
potentially  high  costs  of  incorporating  highly  advanced  training 
support  capabilities  in  developing  systems  or  as  part  of  system 
retrofits,  it  may  be  quite  acceptable  Co  provide  ET  capabilities  which 
are  not  "state  of  Che  arc,"  in  future  efforts  to  develop  systems 
incorporating  ET.  Where  advanced,  sophisticated  capabilities  are 
useful  or  necessary  Co  support  training,  these  should  obviously  be 
seriously  considered  for  inclusion  in  ET  components.  However,  ET 
should  be  considered  as  part  of  Che  total  training  system,  and  not  in 
isolation  from  other  training  elenenCs  such  as  mission  simulators, 
part-task  training  devices,  Conduct-of-Fire  Trainers  (COFTs),  and 
traditional  training  approaches. 


ET  Development  and  the  System  Development  Process 

As  discussed  earlier,  ET  components  may  be  developed  concurrent 
with  the  prime  item  system,  or  they  may  be  developed  after  the  prime 
item  system  is  fielded.  Of  the  systems  studied  in  this  effort,  the  ET 
components  of  five  were  developed  concurrently  with  their  associated 
prime  item  systems,  while  ET  capabilities  were  added  to  fielded  systems 
in  four  cases.  Both  cases  have  generally  resulted  in  ET  that  Crains  in 
an  effective  manner,  within  its  limitations.  There  is  no  indication  in 
the  data  that  development  of  ET  capabilities  concurrent  with  prime  itan 
systems  results  in  training  which  is  in  any  sense  "better"  chan  Chat 
provided  by  retrofit  ET  components.  However,  in  all  the  cases  studied, 
Che  training  provided  by  ET  was  of  limited  scope.  None  of  the  ET 
components  was  capable  of  full-task  training,  although  the  ACTS  and 
AWACS  ET  components  came  near  Co  this  capability  with  their  ability  Co 
provide  concurrent  team-oriented  training  for  multiple  operator 
positions.  Even  in  these  cases,  there  were  limitations  imposed  on  Che 
scope  of  training  due  to  other  factors.  These  are  discussed  later  in 
this  section. 

It  is  interesting  Co  note  Chat  the  only  ET  components  reported  Co 
have  integration  or  reliability  problems  when  used  with  their  prime 
systems  are  CettofiL  cwnpoueuts  (AN/TFQ— 29  and  CST5).  This  suggests 
Chat  there  may  be  some  inherent  advantage  Co  concurrent  design  and 
development  of  ET  components  and  the  prime  systems  in  which  they  are 
embedded.  From  the  viewpoint  of  requirements  integration  and  system 


design,  it  would  appear  to  be  a  more  efficient  and  effective  practice 
to  anticipate  the  need  for  ET  at  the  time  system  requirements  are 
established,  and  develop  the  ET  capability  concurrent  with  other  prime 
system  capabilities.  Anecdotal  data  gathered  during  this  study  tend  to 
support  this  assertion.  This  will  probably  not  be  possible  in  all 
cases,  however.  As  was  the  case  with  some  of  the  retrofit  ET 
components  studied  in  this  effort  (All/TPQ-29  and  WWMCCS  CAI),  require¬ 
ments  for  ET  capabilities  may  surface  only  after  a  system  has  been 
fielded,  and  experience  with  the  system  has  accumulated.  There  may 
also  be  future  “opportunity"  developments  of  ET,  as  was  the  case  with 
the  F-lS  OBS.  This  ET  component  originated  as  an  acceptance  test 
device  for  some  of  the  F-15  avionics.  The  test  device’s  capability  to 
dynamically  display  information  on  a  Heads-Up  Display  (HUD)  was  noted, 
and  the  potential  for  providing  stimulation  for  practice  of  some 
mission  tasks  was  subsequently  explored. 

Another  interesting  observation  derived  from  the  data  is  that  the 
ET  components  studied  do  not  appear  to  be  well-coordinated  with  total 
training  system  requirements.  Anecdotal  reports  indicate  that  there 
was  little,  if  any,  systematic  consideration  of  ET  as  a  component  of 
the  total  training  system  supporting  any  of  the  systems  which  were 
studied.  Further  supporting  this  point  is  the  fact  that  no  explicit 
information  concerning  training  objectives  supported  nor  any  of  the 
typical  Instructional  Systems  Development  (ISD)  audit  trail  data  were 
obtainable  for  any  of  the  ET  components  addressed  in  the  effort.  Also, 
while  ET  for  these  systems  is  generally  perceived  as  beneficial  and 
well-liked  by  its  users,  interview  data  gives  the  impression  that  the 
capability  to  provide  more  training  via  ET  than  is  currently  possible 
.  would  be  welcomed. 

A  speculative  conclusion  from  these  data  is  that  the  training 
provided  by  the  ET  components  studied  was  not  systematically  developed 
to  support  explicit  training  requirements.  This  points  up  a  need  in 
future  consideration  of  ET  to  treat  the  ET  component  as  one  portion  of 
the  total  training  system,  and  to  ensure  that  it  receives  consideration 
equivalent  to  (for  example)  stand-alone  training  devices  as  a  means  to 
support  established  training  requirements.  Clearly,  there  should  not 
be  ET  when  ET  is  not  needed  or  where  training  requirements  can  be 
satisfied  in  more  cost-effective  ways.  ET,  however,  must  also  be 
considered  as  a  component  of  the  overall  hardware  and  software  system 
during  initial  concept  development  and  design,  to  insure  effective 
integration  of  the  ET  component  with  the  balance  of  the  system.  This 
implies  that  a  means  of  considering  both  ET  and  the  total  training 
system  must  be  implemented,  coordinated  with  overall  system  develop¬ 
ment.  Explicit  guidance  for  identifying  both  the  role  of  ET  as  a 
component  of  the  prime  item  system  and  as  a  component  of  the  total 
training  system  will  be  required  to  ensure  such  consideration. 
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ET  Utilization  and  Relationships  with  System  Constraints 


A  broad  variety  of  means  of  utilizing  ET  in  conjunction  with  the 
prime  iten  systems  was  found  in  the  systems  studied.  Utilization 
ranged  from  completely  off-line  training  found  in  AN/TPQ-29-Hawk  ET  to 
the  capability  to  train  very  nearly  concurrent  with  system  operations 
noted  with  AWACS  ET.  The  implementation  and  use  of  Che  ET  component 
appears  to  be  partially  determined  by  system  SOR  requirements.  Where 
SOR  requirements  are  high  (e.g.,  practically  instantaneous  mission 
capability  must  be  maintained  on  a  continuous  basis),  the  prime  system 
cannot  be  taken  completely  off-line  in  order  Co  conduct  training  via 
ET.  Where  this  was  found  Co  be  Che  case  in  the  systems  studied 
(Patriot  TPT,  AWACS,  CSTS,  ACTS,  and  WWMCCS),  multiple  operator 
stations  were  typically  available.  In  each  case,  one  or  more  operator 
stations  could  be  taken  off-line  to  provide  training,  while  other 
stations  continued  in  use  to  meet  mission  requirements.  In  cases  where 
this  does  not  compromise  system  capabilities  or  readiness  Co  any 
significant  extent,  the  ability  to  conduct  concurrent  operations  and 
training  appears  to  be  an  ideal  implementation  of  the  ET  capability. 

For  systems  with  lower  SOR  requirements  on  a  system-by-systan 
basis,  it  is  sometimes  feasible  to  "down"  systems  at  certain  times  in 
order  to  conduct  training.  This  was  found  to  be  acceptable  with 
Missile  Minder  ET  and  ( to  a  certain  extent)  with  AN/TFQ-29.  Missile 
Minder  ET  has  Che  capability  to  be  used  in  an  on-line  fashion,  but  is 
typically  not  so  used,  due  to  Che  risk  of  ET-generated  "targets"  being 
broadcast  over  command  and  control  networks  and  misinterpreted  as 
"live"  targets.  This  possibility  was  found  to  be  unacceptable  in 
practice.  Utilization  of  Che  AN/TPQ-29  with  Hawk  sysCens  demands  Chat 
the  Hawk  systems  be  taken  off-line,  since  the  radar  components  must  be 
de-tuned  from  operational  status  to  be  utilized  with  the  AN/TPQ-29,  and 
accessory  connections  made  to  the  ET  component  hardware.  This  process 
essentially  renders  the  Hawk  system  used  with  the  AN/TPQ-29 
non-mission-capable,  since  Che  radar  is  not  within  normal  operational 
parameters . 

The  remaining  two  ET  components,  F-14  IFT  and  F-15  OBS,  are 
utilized  in  an  off-line  mode,  when  an  aircraft  is  dedicated  for 
training  use  (F-15  OBS)  or  in  transit  in  a  non-tactical  environment 
(F-14  IFT).  The  use  of  ET  in  Che  tactical  aircraft  systems  studied 
provides  some  noteworthy  benefits.  With  both  ET  components,  practice 
of  mission-critical  Casks  in-flight  is  possible  without  Che  need  for 
dedicated  target  or  aggressor  aircraft,  range  instrumentation,  or  other 
external  support  which  is  often  difficult  to  arrange  or  costly  Co 
obtain.  In  both  cases,  the  principal  constraint  on  utilization  of  Che 
ET  components  is  sufficient  clear  airspace  to  permit  maueuvetiug  for 
task  practice.  This  suggests  that  such  implementations  of  ET  can 
provide  opportunities  for  deployed  or  simply  squadron-assigned  aircrews 
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to  maintain  significant  proficiency  in  many  mission  tasks  without  the 
need  to  access  remote  range  facilities  or  instrumentation,  at  little 
more  than  the  cost  of  aircraft  flight  hours.  Given  the  high  combat 
readiness  requirements  of  tactical  aircrews  and  existing  airspace  and 
maneuvering  restrictions,  this  could  prove  to  be  a  "force  multiplier" 
of  some  magnitude. 


ET  Utilization  and  Impacts 

In  general,  the  systems  with  which  the  BT  components  are 
associated  and  the  manner  of  use  of  the  systans  (at  least  during 
peacetime)  provide  sufficient  opportunity  for  use  of  the  ET 
capabilities  to  train  operators  or  crewmembers.  This  is  true  even 
though  the  actual  use  of  the  ET  components  may  be  difficult  (as  with 
the  AN/TPQ-29)  or  may  not  provide  the  total  range  of  training  which 
might  be  desirable  in  an  ideal  case.  The  ET  components  studied  appear 
in  general  to  add  little  in  the  way  of  logistic  or  maintenance  burden 
to  their  associated  systems,  especially  in  the  cases  where  ET 
components  were  designed  concurrent  with  the  prime  system  and  are 
wholly  integrated  in  prime  system  design.  This  may  be  a  false 
concltision,  however,  as  it  would  be  most  difficult  to  segregate 
operational  or  logistic  impacts  of  a  wholly  integrated  BT  component 
from  similar  characteristics  of  the  systems  in  which  they  are  embedded. 
Such  data  were  not  available  to  the  study  team  during  the  course  of  the 
review. 

During  the  review,  it  was  noted  that  no  use  was  made  (cr  could  be 
made)  of  the  various  ET  components  to  support  training  for  maintenance 
of  the  systems  studied.  Anecdotal  reports  gathered  during  the 
interviews  suggest  that  the  capability  to  support  some  maintenance 
training  for  some  of  the  systems  was  being  considered  as  a  retrofit  to 
ET  components.  It  is  speculated  that  the  most  valuable  use  of  an  ET 
component  for  maintenance  training  would  be  to  support  the  development 
of  troubleshooting  and  diagnostic  fault  isolation  skills  for  complex 
systems.  These  are  skills  which  are  scarce  and  difficult  to  build, 
since  fault  and  symptom  patterns  for  some  critical  maintenance  problems 
occur  seldom,  providing  scant  opportunity  for  the  maintainer  to  learn 
to  recognize  such  stimuli.  Also,  the  infra-skills  and  reasoning 
patterns  of  maintenance  fault  isolation  are  difficult  to  train  without 
numerous  examples  of  symptom  patterns.  ET  may  provide  a  useful  and 
convenient  means  of  building  and  sustaining  such  skills  for  future 
systems,  at  relatively  low  cost. 


Training  Characteristics  and  ET 


During  this  study,  a  nimber  of  training- related  features  were 
sought  in  the  ET  components  studied.  Practically  none  of  the  ET 
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components  incorporate  the  more  advanced  training  presentation  or 
support  features  which  were  looked  for,  yet  all  train  more  or  less 
effectively.  This  finding  more  or  less  contradicts  an  implicit 
assumption  that  such  advanced  features  are  necessary  in  order  to  have 
"good"  ET.  While  the  training  provided  by  the  various  ET 
components  Chat  were  studied  generally  falls  short  of  the  trainer's 
ideal  model  of  a  training  system  (including  performance  assessment  and 
feedback  related  to  specific  training  objectives  and  Cask  behaviors), 
each  of  the  BT  components  does  provide  needed  Cask  practice  for  system 
operators.  This  is  perceived  as  a  significant  benefit  by  units  using 
the  ET  components,  as  well  as  by  higher-level  organizational  elements. 


Types  of  Training  Provided  by  ET 

Three  distinct  types  of  training  were  observed  in  the  ET 
components  studied:  individual  training;  team  training  involving 
multiple  personnel  performing  similar  or  different  tasks  on  Che  same 
sysCan;  and  coordinated  training  involving  multiple  systems  of  similar 
or  dissimilar  types.  The  majority  of  individual  training  found  was 
part-mission  Cask  proficiency  training.  Such  training  is  particularly 
useful  for  developing  or  sustaining  critical  portions  of  individual 
task  responsibilities  without  the  necessity  Co  practice  all  mission 
Casks.  Most  individual  training  was  used  for  skill  sustainment;  in 
only  one  case  (CSTS)  was  individual  skill  acquisition  training 
emphasized.  This  was  reportedly  due  to  skill  deficiencies  in  personnel 
arriving  from  shore-based  schools.  The  need  for  school  training  to 
support  skill  development  for  the  DDG-993  class  ("Ayatollah  class") 
guided  missile  destroyers  was  not  anticipated  for  U.S.  Navy  personnel, 
since  the  ships  were  originally  purchased  by  Iran,  and  no  similar  ships 
were  programmed  for  Navy  acquisition.  While  such  situations  are  not 
common,  this  may  indicate  a  role  for  some  future  ET  components: 
compensating  for  deficiencies  in  other  aspects  of  training  which  cannot 
be  redressed  in  other  timely  or  cost-effective  ways.  The  necessity  for 
"filling  gaps"  in  this  manner  will  hopefully  be  minimized  by  adopting  a 
total  training  systems  approach  to  support  material  systems  during 
system  development.  The  possibility  of  using  ET  as  a  "quick  fix," 
however,  should  not  be  discounted  without  careful  consideration. 

Team  Training.  Team  training  on  the  same  system  was  provided  by 
several  of  the  ET  components  studied.  This  type  of  training  seeks  to 
build  and  sustain  skills  associated  with  task  interdependencies 
required  for  successful  system  operation,  through  either  providing 
stimuli  to  all  personnel  to  be  trained  (perhaps  in  differential  ways) 
or  to  key  personnel  whose  actions  and  tasks  cue  other  team  members  to 
perform  their  own  tasks.  Such  training  is  of  particular  value  when 
individuals  operating  dissimilar  (but  related)  equipment  on  one  system 
must  perform  together  (e.g.,  ACTS,  AWACS),  or  where  there  is  redundancy 
iti  uitiuuiiig  oil  similar  workscacions  (e.g.,  Patriot).  As  tor  all  other 
training,  however,  team  training  provided  through  ET  should  be  based  on 
sound,  validated  training  objectives.  Without  more  complete  data  than 
was  available  for  this  study,  relatively  little  can  be  concluded  about 
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the  characteristics  of  the  team  training  provided  by  the  components 
which  supported  team  training. 


One  interesting  phenomenon  relating  to  team  training  was 
identified  from  interviews  concerning  the  F-14  IFT.  In  this  case, 
synthetic  target  information  is  principally  presented  to  the  Radar 
Intercept  Officer  (RIO)  via  the  main  radar  display  in  the  rear  cockpit. 
The  RIO  engages  in  task  performance  in  response  to  the  stimulation 
provided  by  the  ET  component.  As  part  of  performing  his  tasks,  the  RIO 
interacts  with  the  pilot  to  plan  and  coordinate  aircraft  maneuvering  to 
intercept  or  engage  the  simulated  radar  targets.  The  pilot  thus 
receives  practice  in  precision  manuevers  and  in  crew  coordination 
techniques  and  activities  without  receiving  any  direct  stimulation  from 
the  ET  component.  Feedback  on  pilot  performance  comes  from  corrections 
by  the  RIO  to  improve  engagement  parameters  and  from  the  auxiliary 
radar  display  in  the  front  cockpit,  on  which  the  pilot  can  view  the 
simulated  target's  change  in  position  relative  to  the  F-IA.  In  this 
fashion,  the  pilot  receives  highly  mission-relevant  training  without 
explicit  stimulation  by  the  ET  component  because  of  the  crew 
organization  and  task  interdependency  of  crew  duties.  This  is  a 
characteristic  which  should  be  considered  in  the  design  of  future  ET 
components,  since  it  provides  an  opportunity  to  provide  training  for 
crews  without  the  necessity  to  give  explicit,  unique  task  stimulation 
at  each  crew  position. 

Coordinated  Training  for  Multiple,  Dissimilar  Systems.  Three  ET 
components  were  identified  in  this  study  which  (at  least,  theoreti¬ 
cally)  had  the  capability  to  provide  training  for  operators  of 
different  types  of  systems  linked  by  conmunicat ion  networks:  ACTS, 
Missile  Minder,  and  AWACS.  Each  of  these  three  ET  components  can 
provide  target  information  to  platforms  or  sensors  other  than  the 
system  in  which  the  ET  compor >nt  exists.  In  combined-arms  or  coordin¬ 
ated  situations,  such  a  capability  can  provide  higher-level  task 
practice  in  communications,  command  and  control,  or  intelligence 
functioi.s  which  promote  effective  combined  use  of  systems.  For 
example,  AWACS  ET  is  capable  of  sending  real-time  synthetic  target  data 
to  other  aircraft,  to  ground  stations,  and  to  shipboard  command  and 
control  elements.  Such  capabilities  should  be  considered  for  future 
systems  which  are  principally  oriented  toward  Command,  Control, 
Communications,  and  Intelligence  (C3I)  functions,  or  which  serve 
principally  as  sensor  or  data  gathering  platforms  and  feed  data  to 
other  systems. 

A  particular  caution  is  warranted  when  planning  for  ET  components 
which  can  provide  target  or  other  data  to  other  platforms  or  systems, 
however,  in  the  current  study.  Missile  Minder  ET  was  not  used  in  an 
on-line  mode  (although  the  capability  was  present),  since  there  was  the 
possibility  of  communicating  synthetic  target  information  without  its 
being  identified  as  such.  The  potential  for  introducing  "bogus"  target 
information  into  an  operational  situation,  and  having  such  information 
interpreted  as  "real"  target  information  was  considered  to  be 
unacceptable.  Future  ET  components  which  incorporate  such  capabilities 
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should  have  the  ability  to  identify  synthetic  data  introduced  for 
training  purposes  as  synthetic,  if  it  is  to  be  introduced  into 
coordinated  situations  without  restriction.  Alternately,  such 
information  may  be  presented  only  during  periods  specifically  set  aside 
for  training,  to  avert  regrettable  misinterpretations. 


Scenarios  and  Scenario  Requirements 


A  number  of  the  ET  componencs  studied  rely  on  pre-defined 
scenario!  to  provide  practice  and  training  opportunities  for  trainees. 
Typically,  a  limited  number  of  pre~defined  scenarios  is  available  for 
presentation  via  the  ET  component.  Anecdotal  and  interview  data 
suggest  that  the  small  available  number  of  scenarios  provided  in  some 
cases  (notably  the  Patriot  TPT)  restricts  the  quality  and  amount  of 
training  that  can  be  provided.  This  reportedly  is  manifested  by  a 
situation  where,  after  a  number  of  exposures  to  each  available 
scenario,  trainees  "learn  the  scenarios"  (i.e.,  learn  where  and  when  in 
an  exercise  to  expect  particular  targets  to  appear).  In  such  a 
situation,  the  training  value  of  the  scenarios  is  quickly  lost,  since 
the  trainee  is  responding  to  a  known  situation.  This  suggests  that 
when  pre-defined  scenarios  are  to  be  used  to  implement  ET,  a  larger 
nunber  and  variety  of  scenarios  than  is  provided  in  the  systens  studied 
may  be  necessary  to  ensure  effective  sustainment  training. 

The  nature  and  effects  of  the  variables  which  determine  the  number 
and  variety  of  scenarios  required  for  a  particular  implementation  of  ET 
are  currently  not  clear.  No  information  was  available  regarding  the 
decision  process  or  variables  used  to  identify  the  scenarios  included 
in  each  of  the  ET  components  studied,  so  it  is  not  possible  to 
extrapolate  from  "lessons  learned"  from  Che  nine  systems  examined  in 
this  effort.  As  part  of  Che  development  of  guidelines  and  procedures 
for  Che  design  and  implenentat ion  of  ET  components  in  Che  future,  some 
effort  should  be  encerted  Co  identify  at  least  the  major  variables  which 
drive  Che  requirements  for  the  number  and  variety  of  scenarios  Co  be 
provided  to  ensure  continued  training  value  of  ET  components.  Also,  if 
possible,  at  least  a  tentative  model  for  application  of  those  variables 
should  be  developed,  Co  provide,  as  a  minimum,  rough  parametric 
guidance  for  scenario  requirements. 


ET  Interactions  with  Logistics 


Of  the  nine  ET  components  studied,  only  two  (AN/TPQ-29  and  CSTS) 
had  any  reported  effects  on  the  hardware  logistics  of  the  systems  with 
which  they  are  associated.  Both  of  these  components  are  retrofits  Co 
their  prime  item  material  systems.  This  may  have  provided  visibility 
of  logistic  impacts  that  would  not  be  the  case  in  concurrently 
developed  ET  components.  As  mentioned  earlier,  costs  for  concurrently 
developed  ET  components  could  not  be  identified  during  this  effort.  It 
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is  suspected  that  an  attempt  to  segregate  logistic  impacts  would 
encounter  similar  problems.  On  the  basis  of  the  data  available, 
however,  there  is  no  indication  that  having  an  ET  component  results  in 
any  predictable  impacts  on  hardware  logistics. 

It  is  speculated  that  the  presence  of  ET  components  may  have  some 
beneficial  impacts  on  hardware  logistics  in  the  long  run.  More 
consistent  and  frequent  use  of  hardware  systems  to  support  trainin/*  via 
ET  may  actually  reduce  the  nimber  and  severity  of  on-condition 
maintenance  requirements,  since  precipitating  conditions  are  more 
likely  to  be  noticed  when  a  system  is  in  use,  and  corrected  before  they 
lead  to  larger-scale  problems.  Also,  improved  operator  and/or 
maintainer  proficiency  which  may  be  provided  by  ET  may  lead  to  fewer 
"induced"  faults,  since  overall  skill  levels  may  be  improved  and,  thus, 
fewer  errors  in  operating  and  maintaining  the  equipment  will  be  made. 


Software  and  Courseware  Logistics 

Providing  training  via  an  ET  component  implies  that  the  software 
and/or  courseware  by  which  the  ET  component  is  implemented  will  have  to 
be  maintained  and  updated,  both  to  maintain  currency  with  the  material 
system  and  to  rectify  problems  with  the  training,  if  they  exist.  Tlie 
software/ courseware  maintenance  and  update  requirements  for  ET  may 
impact  the  overall  support  manpower  and  equipment  requirements  for  a 
system.  ET  updates  are  dealt  with  in  a  variety  of  ways  in  the  systems 
studied.  In  general,  a  centralized  update  or  configuration  control 
authority  periodically  performs  updates  and  development  of  new  training 
materials  or  scenarios  in  response  to  requirements  from  units  or  other 
users  of  ET.  The  updates  are  then  distributed  to  all  using  sites,  and 
implemented. 

In  two  cases  (F-14  IFT,  F-15  OBS),  ET  scenarios  or  courseware  are 
part  of  or  closely  adjunct  to  general  system  software  and  are  updated 
as  part  of  the  software  update  process.  In  the  remaining  cases,  ET 
courseware  or  scenarios  are  distributed  on  Installable  or  removable 
media,  and  are  updated  or  revised  separate  from  system  software.  In 
all  cases  except  WWMCCS,  however,  the  ET  courseware  or  scenarios  are 
implemented  as  software  —  computer  code,  rather  than  data  acted  on  by 
software. 

This  type  of  implementation  requires  considerably  more  effort  in 
the  training  maintenance  process  than  when  ET  courseware  or  scenarios 
are  implemented  as  data  or  parameters  to  modify  the  actions  of 
independent  software.  In  none  of  the  cases  examined  in  this  effort  was 
an  authoring  system  capability  provided  to  support  maintenance  and 
update  of  ET  scenarios  or  courseware.  Such  capabilities  have  been 
found  to  dramatically  reduce  both  development  and  update  time  and 
effort  when  available  for  more  conventional  computer-based  instruction. 
While  there  is  no  basis  to  estimate  the  amount  of  savings  which  may  be 
realized  from  having  authoring  system  capabilities  to  update  ET 
training,  such  capabilities  should  be  seriously  considered  for  future 
ET  components,  to  help  to  minimize  the  support  manpower  burden 
associated  with  the  presence  of  the  ET  component. 


42 


APPENDIX  A 

PATRIOT  MISSILE  SYSTEM 
TROOP  PROFICIENCY  TRAINER  (TPT) 
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PATRIOT  MISSILE  SYSTEM  TM)OP  PROFICIENCY  TRAINER  (TPT) 


The  Patriot  Missile  System  is  a  surface-launched,  radar-guided, 
anti-aircraft  missile  system.  A  Patriot  firing  battery  has  five  major 
components,  which  are  all  mobile  and  transportable  by  ship,  rail, 
airplane,  and  helo  lift.  These  components  are  the  engagement  control 
station  (ECS),  radar  set,  electrical  power  plant,  launcher/missile 
canister,  and  antenna/mast  group.  These  components  are  shown  in  Figure 
A-I  as  they  would  be  deployed  in  a  battery. 
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Figure  A-1, 


Patriot  Missile  System  Battery  CoEplimeuL 


When  activated,  the  radar  searches  its  designated  air  space  and,  upon 
detection,  relays  target  information  to  the  ECS.  The  ECS  compares  each 
target  with  the  target  tracks  currently  held  and,  if  it  is  a  new  tar¬ 
get,  the  system  begins  tracking  it.  The  target  is  automatically  iden¬ 
tified,  its  engagement  eligibility  is  determined,  and  threat  orders  are 
issued.  Patriot  is  a  highly  advanced  system  designed  to  replace  the 
IHAWR  and  Nike  Hercules  missile  systems. 


CoBiponent  Descriptions 

Engagement  Control  Station.  The  ECS  is  tasked  with  monitoring 
readiness,  threat-ordering,  giving  priorities  to  radar,  determining 
electronic  counter-countermeasures  (ECCM) ,  computing  guidance  commands, 
providing  a  soldier-machine  interface,  and  conmunicating  with  battalion 
headquarters.  Within  the  ECS  is  the  display  and  control  group 
(operator  stations)  and  the  weapons  control  computer  (WCC)  which 
controls  radar  functions  and  launching  stations,  and  provides  guidance 
commands  to  the  missile.  The  ECS  is  truck-mounted  and  has  a  VHP 
communications  mast  for  remote  control  of  up  to  eight  launching 
stations. 

Radar  Set.  The  radar  set  is  a  multi- function  phased-array  radar 
that  performs  very  high-  to  very  low-altitude  surveillance,  target 
detection,  target  identifications,  target  track,  missile  track,  missile 
guidance,  and  ECCM.  It  searches,  detects,  identifies,  tracks,  and 
illuminates  targets,  and  communicates  with  the  Patriot  missile.  It  is 
trailer-mounted  for  portability. 

Weapons  Control  Computer.  Data  processing  takes  place  within  the 
radar  equipment  and  WCC.  A  library  of  known  targets  and  their 
characteristics  is  compared  with  the  detected  target's  characteristics. 
When  a  correlation  is  found,  the  target  is  given  a  classification. 

This  relieves  the  operators  from  having  to  memorize  vast  amounts  of 
target  characteristic  data,  such  as  radar  parameters  or  jamming 
characteristics.  The  data  processor  automatically  responds  to  target 
ECM  by  applying  ECCM.  This  also  relieves  operators  from  memorizing 
manual  ECCM  procedures  which,  in  earlier  systems,  took  time  and  often 
resulted  in  missed  targets. 

Antenna/Mast  Group.  The  antenna/mast  group  has  quick-erect 
antennas  and  amplifiers  for  UHF  communications  between  the  information 
and  coordination  central  (ICC)  of  the  Patriot  battalion,  the  battalion 
communications  relay  group  (CRG),  and  the  battery  ECS. 

Launching  Station.  The  launching  station  is  remotely  controlled 
from  the  ECS.  It  is  a  self-contained  unit  with  a  built-in  power 
supply.  Under  ECS  control,  each  launching  station  can  launch  up  to 
four  missiles  at  designated  targets.  Each  missile  is  contained  in  a 
canister,  which  functions  as  a  shipping  and  storage  container  as  well 
as  a  launch  tube.  After  launch,  the  missile  is  command-guided  through 
midcourse.  At  that  point,  the  system  automatically  selects  one  of  four 
terminal  guidance  modes,  depending  on  the  nature  of  the  target  and  the 
jamming  being  received. 
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Troop  Proficiency  Trainer.  The  Troop  Proficiency  Trainer  (TPT)  is 
a  sec  of  integrated  software  residing  in  the  ECS  and  ICC  computers.  No 
special  equipment  is  needed  to  operate  the  TPT.  Each  firing  battery 
Crains  in  a  "stand-alone"  configuration  when  practicing  air  defense 
artillery  exercises  on  Che  ECS  or  ICC.  The  firing  batteries  and  Che 
battalion  ICC  can  be  networked  by  synchronizing  Che  fire  units  and 
selecting  a  scenario  designed  for  Che  network  configuration.  Practice 
in  a  network  configuration  provides  the  soldiers  with  sustainment 
training  in  the  normal  mode  of  operation — a  battalion-directed  air 
defense. 


ET  Training  Features 

Computer-Oriented  Features.  The  Patriot  TPT  is  not  equipped  with 
any  special  training  features  within  its  computer  system.  CAI,  AI,  and 
computer-generated  imagery  are  not  features  of  the  TPT,  even  though  the 
ECS  provides  a  suitable  environment  for  CAI. 

Training  Management  Features.  The  TPT  has  a  scenario  authoring 
capability,  which  is  Che  responsibility  of  the  battalion  training 
officer.  A  library  of  17  scenarios  is  updated  every  quarter.  The 
training  officer  chooses  and  installs  five  of  the  17  scenarios. 
Scenarios  can  be  written  to  train  either  individual  Patriot  ECS 
operators  or  all  of  the  battalion  ECS  operators.  Scenario  time  lengths 
are  selectable;  however,  scenarios  are  preprogrammed,  which  prevents 
any  on-line  scenario  modifications  from  being  made.  The  TPT  does  not 
have  adaptive  training  nor  built-in  record-keeping  capabilities. 

Automated  Training  Features.  The  TPT  has  no  special  automated 
training  features.  The  TPT  scenarios  provide  proper  stimulation  for 
practicing  ECS  operational  tasks;  however,  without  any  automated 
feedback,  performance  recording,  performance  measurement,  or  report 
generation,  there  is  a  requirement  for  an  over-the-ahoulder  training 
observer.  The  only  report  generated  is  a  target  summary/description, 
which  can  be  printed  after  the  training  session.  An  example  of  the 
target  suoimary  printout  is  shown  below  in  Figure  A-2. 


HH:MM:SS 

TGTNO  THRT  RT  TLL  ENGSTAT  ID/SZ  TOLD  IN  ID:XXXXX/XXX 

XXX/  XX  +XX  ♦XX  X.XXX/  XX/  LOCAL  ID:XXXX/XXX 
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XXXXXXXX  XXX  XXX 
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XXXX 

X 
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3 

POP-UP : 

X 

CODE :  XXXX  XXXX 

XXXX 

XXXX 

PROHIB  VOL: 

X 

RESPONSE:  XXXXXXX  XXXXXXX  XXXXXXX  XXXXXXX  RESTR  VOL:  X 
QUALITY :  XXXXXXX  XXXXXXX  XXXXXXX  XXXXXXX  IFF  EVAL:  XXXX 


Figure  A-2.  TPT  Target  Data  Printout 
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The  information  contained  in  the  printout  is  somewhat  useful  for 
assessing  engagement  outcomes,  but  it  is  lacking  any  information  about 
operator  responses.  A  complete  mission  printout  has  one  of  these 
target  data  tables  for  each  target.  The  alphanumeric  data  are 
represented  in  the  figure  above  by  X's.  There  is  no  difference  between 
the  printout  for  the  TFT  targets  and  the  printout  for  the  actual 
detected  targets. 

Scenario  Control  Features.  The  TFT  does  not  have  scenario  freeze, 
scenario  playback,  or  scenario  fast-forward  functions. 

Instructional  Features.  The  TFT  does  not  have  a  demonstration 
mode,  which  a  training  officer  might  use  to  explain  advanced  target 
management  techniques.  It  also  does  not  have  a  user-help  facility, 
which  a  trainee  or  training  officer  could  use  while  running  scenarios 
or  operating  the  TFT  equipment. 

ET/System  Coordination  Features.  The  TFT  is  an  integral  part  of 
the  actual  equipment.  It  uses  actual  equipment  and  simulates  the  task 
environment  with  a  high  degree  of  fidelity.  The  TFT  disables  the  radar 
equipment,  which  makes  it  strictly  an  off-line  device.  It  can  be 
operated  in  a  stand-alone  configuration  when  training  one  battery  or  in 
a  networked  configuration.  Network  training  requires  using  a  scenario 
designed  to  train  the  battalion  and  synchronizing  the  time  clocks  in 
each  battery.  Networked  configurations  are  the  normal  operational  mode 
for  Fatriot  batteries. 


Factors  Affecting  Training  with  ET 

Logistical  Impact  Factors.  The  TFT  has  not  increased  parts 
requirements,  maintenance  requirements,  or  equipment  wear.  There  is  no 
difference  between  equipment  operation  during  a  TFT  scenario  and  during 
an  actual  mission  except  that,  when  the  TFT  is  activated,  it  disables 
the  actual  radar  and  launchers. 

Time  Impact  Factors.  The  TFT  and  the  Fatriot  missile  system  are 
very  reliable,  with  low  system  down-time  ratings.  Both  the  operators 
and  the  Patriot  systems  are  available  for  training  purposes,  within  the 
normal  operational  constraints  and  routine  battery  duties.  The 
schedule  for  a  typical  Fatriot  fire  section  is  two  eight-hour  shifts 
for  training  and  one  eight-hour  shift  for  maintenance.  The  TFT  was 
developed  along  with  the  Fatriot  system,  and  there  are  no  significant 
design  problems. 

Operating  Impact  Factors.  The  Fatriot  was  designed  to  be  easy  to 
operate  and  to  facilitate  the  operator  tasks  capable  of  being  auto¬ 
mated.  Tasks  such  as  identifying  targets  based  on  radar  characteris¬ 
tics  are  automated!  eliminating  the  need  for  operators  to  memorize  a 
large  quantity  of  such  Information.  The  TFT  is  also  simple  to  operate 
and  requires  a  minimal  amount  additional  instruction.  Scenario 
authoring  is  probably  the  most  difficult  TFT  task  to  train  and  requires 
special  attention  to  ensure  that  realistic  and  meaningful  scenarios  are 
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created.  Changing  from  an  operational  mode  to  the  TPT  training  mode  is 
instantaneous  and  easy,  as  is  the  change  back  to  an  operational  mode. 


ET  Training  Functions 

Task  Categories.  The  TPT  trains  equipment  operation  tasks  at  the 
ECS  and  ICC.  In  a  network  configuration,  it  trains  team  operation 
casks.  Since  the  conanon  operational  configuration  for  Patriot  is  a 
networked  battalion,  it  is  important  that  Che  TPT  have  a  network 
training  capability.  The  TFT  does  not  provide  maintenance  training. 

Training  Uses.  The  TPT  is  used  primarily  as  an  individual  and 
team  training  device.  It  is  also  used  for  preparatory  exercises  prior 
to  a  readiness  evaluation  or  before  an  operator  is  transferred  to  an 
overseas  unit.  Results  of  TPT  preparatory  exercises  are  used  to 
identify  areas  of  low  operator  proficiency,  so  that  the  operator  can 
concentrate  on  strengthening  Che  particular  Casks  associated  with  Che 
weak  area.  The  structured  readiness  evaluations  used  by  Che  Army  do 
not  use  the  TPT  capabilities,  although  it  would  not  be  difficult  to 
create  special  scenarios  for  readiness  evaluation  teams  Co  use  when 
grading  battalion  performance. 

Training  Types.  The  TPT  is  a  full-scenario  training  device  which 
is  capable  of  part-scenario  training,  provided  that  Che  scenario  is 
authored  for  a  specific  mission  area.  It  is  possible  to  perform 
part-task  training  on  the  TPT  in  its  present  form,  but  part-task 
training  is  not  normally  performed  with  TPT. 

Training  Levels.  The  TPT  is  used  for  sustaining  operator  Casks. 

It  is  not  used  for  initial  training  in  Che  units,  but  it  may  be  used  by 
the  schools  to  train  the  acquisition  of  skills  on  Che  actual  equipment. 
Full  mastery  of  skills  is  not  currently  trained  using  the  TPT,  but 
advanced  scenarios,  with  higher  demands  placed  on  Che  operator,  could 
be  authored  and  used  for  this  purpose. 
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MISSILE  MINDER  COMMAND  AND  CONTROL  SYSTEM 


The  Missile  Minder  Cotnmand  and  Control  System  provides  the  tacti*- 
cal  command  and  control  for  air  defense  firing  units.  It  commands  and 
controls  Nike  Hercules,  Hawk,  and  Patriot  missile  systems,  at  either 
the  battalion  or  the  group  level.  The  major  components  include  two 
self-contained  situation  display  consoles,  radar  interface  equipment 
(RIE),  automatic  data  processing  equipment,  and  communications 
equipment,  which  are  all  housed  within  the  TSQ-73  shelter.  The  shelter 
is  normally  mounted  on  a  five-ton  truck  for  portability  but  can  be 
mounted  on  a  platform  on  the  ground.  Figure  B-1  shows  the  Missile 
Minder  shelter  and  the  locations  of  the  components  inside  it. 


Component  Descriptions 

Display  and  Control.  The  two  self-contained  situation  display 
consoles  provide  the  operator  with  position-referenced  situation  data 
and  the  capability  to  enter,  modify,  and  delete  information  in  the  data 
processor  display  files.  The  consoles  have  five  possible  modes  of  op¬ 
eration:  tracking,  tactical,  tracking/tactical,  monitor,  and  test.  The 
data  display  group  provides  unit  fire  status  information,  weapons  sta- 
tusm  alert  conditions,  and  system  fault  conditions.  Tactical  infor¬ 
mation  concerning  track  positions,  weapon  positions,  maps,  jam  strobes, 
velocity  vectors,  safe  corridors,  pairing  lines,  and  defended  areas  and 
points  is  displayed  for  the  operator. 

Radar  Interface  Equipment.  The  radar  interface  equipment  (RIE) 
obtains  the  following  information  from  local  r  dars:  radar  target  and 
sweep  position  data,  normalized  radar  data,  video  target  data,  and 
internally  digitized  data.  It  also  accepts  information  from  local 
identification  friend-or-foe  (IFF)  equipment  and  decodes  these  IFF 
signals  to  identify  aircraft,  to  recognize  aircraft  emergencies,  Co 
determine  height  of  aircraft,  and  to  track  aircraft  not  detectable  by 
the  primary  radar.  The  RIE  receives  the  data,  prepares  the  data  for 
use  by  the  automatic  data  processor  and  data  display,  group,  correlates 
target  positions  to  determine  azimuth  and  range,  updates  target 
reports,  and  verifies  valid  targets. 

Data  Processor.  The  automatic  data  processor  provides  data 
processing  of  radar  signals,  simulation  routines,  communications,  and 
display  data  for  the  consoles,  and  it  mechanizes  operator-initiated 
commands.  It  interfaces  with  all  other  equipment  except  the  voice 
communication  gear.  It  assigns  the  appropriate  surface-to-air  missile 
to  each  threat  target  and  updates  air  defense  units  on  status,  condi¬ 
tion,  and  activity  changes. 
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1 .  Voice  comm  central  panel 

2.  Patch  panel 

3.  Maintenance  bench 

4.  Keyboard  printer 

5.  Voice  comm  station 

6.  Environmental  control  panel 

7.  Pressure  sensing  module  control 

8.  Blackout  curtain 

9.  Voice  comm  station 

10.  Blower  (ducting  removed) 

1 1 .  Display  console  assembly 

1 2.  Status  display  panel 

1 3.  Display  console  assembly 

14.  Escape  hatch 

15.  Blower 

1 6.  Radar  interface  equipment  panel  II 

1 7.  Radar  interface  equipment  panel  I 

1 8.  ADP  status  and  control  panel 


19.  Equipment  rack 

20.  ADP  interface  panel 

21 .  ADP  extemel  interface  panel 

22.  Equipment  rack  3 

23.  Equipment  rack  2 

24.  Data  comm  panel 

25.  Equipment  rack  1 

26.  Radar  simulator  panel 

27.  Radar  interface  panel 

28.  Magnetic  tape  unit 

29.  Module  test  set 

30.  Storage  drawer 

31.  Oscilloscope 

32.  Safa 

33.  Storage  drawers  (5  places) 

34.  Main  power  panel 

35.  Main  power  enclo:  :re 

36.  Voice  comm  central  unit 


Figure  B-1.  AN/TSQ-73  Missile  Minder  Shelter 
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Communication  Equipment.  The  communications  equipment  provides 
voice  and  digital  data  links  between  the  automatic  data  processor  and 
the  console  operator,  as  well  as  among  the  members  of  the  net.  Voice 
communications  are  through  a  standard  semi-automatic  telephone  switch¬ 
ing  system.  Data  communication  is  the  interface  between  the  automatic 
data  processor  and  the  remote-site  data  system. 

ET  Component .  The  ET  component  is  integrated  software  in  the 
operational  system.  Users  of  ET  use  actual  equipment,  including  a 
keyboard,  magnetic  tape  unit,  keyboard/printer  unit,  and  monochrome  CRT 
display.  Scenario  set-up  data  are  stored  on  a  magnetic-tape  cartridge, 
called  a  RAID  tape,  which  is  the  only  ET-unique  equipment.  Scenario 
data  are  extracted  to  a  second  magnetic  tape  unit.  From  the  extracted 
data,  a  raid  summary  report,  which  includes  basic  performance  informa¬ 
tion,  can  be  printed  out  on  the  keyboard/printer  unit.  These  perfor¬ 
mance  data  are  not  useful  to  a  training  officer,  since  they  are  limited 
to  hits  and  misses. 


ET  Training  Features 

Computer-Oriented  Features.  The  Missile  Minder  ET  is  not  equipped 
with  a  CAl  mode  of  operation,  does  not  use  AT  processing,  and  does  not 
have  computer-generated  imagery.  The  Missile  Minder  shelter  presents  a 
suitable  environment  for  CAI,  but  a  CAT  capability  has  not  been 
incorporated. 

Training  Management  Features .  Missile  Minder  has  no  adaptive 
training  or  on-line  scenario  modification  capabilities.  There  are  no 
built-in  record-keeping  capabilities.  All  scenario  authoring  is 
performed  at  the  Software  Support  Center,  Ft.  Bliss,  Texas,  where  the 
RAID  tapes  are  authored.  Thus,  the  Missile  Minder  systems  has  no 
unit-level  scenario  authoring  capability.  However,  each  unit  has  a 
library  of  RAID  Capes  from  which  to  choose. 

Automated  Training  Features.  Missile  Minder  is  capable  of  limited 
performance  recording.  The  recorded  data  include  the  number  of 
successful  kills,  missed  targets,  and  missiles  expended.  These  data 
are  useful  from  Che  operational  standpoint,  but  provide  little  help  for 
the  trainer  or  trainee.  From  these  recorded  data.  Missile  Minder 
generates  a  raid  simmary  report,  which  is  printed  on  Che 
keyboard/printer  unit.  This  printout  provides  a  readout  of  performance 
information,  cs  shown  below  in  Figure  B-2.  ET  in  Missile  Minder  does 
not  present  any  feedback  to  the  trainee,  nor  does  it  have  a 
performance-measuring  capability. 

Scenario  Control  Features.  Missile  Minder  ET  is  capable  of 
replaying  a  raid  scenario  at  the  display  console.  A  replay  is 
performed  by  rewinding  the  tape  to  a  desired  point  and  playing  the 
scenario  from  that  point.  There  is  no  scenario  freeze  or  a  scenario 
fast-forward  capability. 
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CONFIGURATION.  XXXXXXXXX  PAGE  XXXX 

DATE:  MM/DD/YY  TIME:  HH:MM:SS  SITE:  XXXXXXXX  RAID  TAPE:  XXXXXXXX 


RAID  SUMMARY  REPORT 

TRACK  AND  MISSILE  COUNTS 

HOSTILE  TRACKS  XXX 
UNKNOWN  TRACKS  XXX 
FRIENDLY  TRACKS  XXX 
TRaJKS  engaged  XXX 
MISSILE  EXPENDED  XXX 

ENGAGEMENT  TERMINATIONS 

EFFECTIVE  XXX 
INEFFECTIVE  XXX 
OTHER 

AVERAGE  MISSILES  EXPENDED 
per  ENGAGED  TRACK  XXX 

ASSIGNMENTS 

INBOUND  XXX 
OUTBOUND  XXX 

MANUAL  XXX 
AUTO  XXX 


CONFIGURATION:  XXXXXXXXX  PAGE  XXXX 

DATE:  MM/DD/YY  TIME:  HH:MM:SS  SITE:  XXXXXXXX  RAID  TAPE:  XXXXXX 

FIRE  UNITS  THAT  EXPENDED  ALL  MISSILES 

XXXXX 


Figure  B-2.  Missile  Minder  Raid  Summary  Report 


Instructional  Features.  Missile  Minder  does  not  have  a 
demonstration  mode  that  could  be  used  by  a  training  officer  to  show  a 
trainee  some  advanced  coimnand  tactics,  target  management,  or  missile 
control.  There  is  no  user-help  facility  to  help  the  training  officer 
to  set  up  a  scenario  or  use  ET. 

ET/System  Coordination  Features.  ET  in  Missile  Minder  is  fully 
integrated  within  the  operational  e^uip«uerit.  are  no  aigmiicant 

differences  between  the  operational  equipment  and  ET,  with  the 
exception  of  the  RAID  tape.  Although  Missile  Minder  ET  was  designed  to 
be  used  on-line,  the  simulated  targets  that  would  be  generated  in  an 
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on-line  mocTe  would  enter  the  Air  Force  Communication  Report  Center 
(CRC)  and  be  perceived  as  real  contacts.  As  a  result,  all  Missile 
Minder  units  operate  ET  in  an  off-line  mode.  Since  Missile  Minder  is  a 
command  and  control  device,  it  is  possible  to  coordinate  training  with 
Patriot,  Hawk,  and  Nike  Hercules  missile  battalions.  Thus,  Missile 
Minder  ET  can  link  simulated  targets  and  provide  training  for  Missile 
Minder  operators,  as  well  as  for  operators  at  these  other  participating 
units. 


Factors  Affecting  Training  with  ET 

Logistical  Impact  Factors.  ET  had  no  significant  logistical 
problems  other  than  equipment  availability.  ET  is  integral  to  the 
weapon  system  and  did  not  increase  the  necessary  number  of  parts. 
A.lthough  raid  tapes  are  required  for  ET,  they  are  not  considered  a 
significant  factor.  No  additional  maintenance  requirements  resulted 
from  including  ET,  and  no  increase  in  equipment  wear  was  indicated  due 
to  ET.  Simulation  fidelity  is  considered  very  good,  with  no  notable 
differences  between  the  actual  operational  environment  and  the  ET 
stimulated  environment. 

Time  Impact  Factors.  Overall,  the  Missile  Minder  system  is  very 
reliable  and  has  a  minimal  amount  of  down  time.  Tlie  equipment  is  nor¬ 
mally  used  for  training  purposes  prior  to  a  readiness  evaluation,  and 
it  is  seldom  available  for  individual  unit  training.  Since  Missile 
Minder  is  a  command  and  control  system,  the  SOR  requirements  have  had  a 
significant  impact  on  equipment  availability  for  training.  They  have 
forced  the  ET  to  be  used  exclusively  in  an  off-line  mode. 

ET  for  the  Missile  Minder  was  developed  during  the  early  stages  of 
weapon  system  development.  One  significant  design  problem  has  been  the 
amount  of  internal  memory.  Initially,  Missile  Minder  had  a  64  kilobyte 
memory,  with  24  kilobytes  needed  for  bootstrapping  the  system.  This 
left  40  kilobytes  available  for  data  processing  and  other  operational 
functions.  Thus,  a  limited  amount  of  space  remained  for  ET  processing 
commands.  A  future  64-kilobyte  memory  expansion  is  planned,  to 
eliminate  some  of  the  memory  constraints. 

Operating  Impact  Factors.  Both  the  operational  system  and  the  ET 
are  considered  simple  to  use.  Initializing  ET  only  requires  installing 
the  raid  tape  in  the  magnetic  tape  unit  and  starting  it.  To  start  or 
stop  a  raid  tape  scenario  is  nearly  instantaneous.  It  is  accomplished 
by  pressing  a  switch. 


ST  Training  Functions 

Task  Categories .  Missile  Minder  ET  trains  individual  equipment- 
operation  tasks,  as  well  as  team  tasks.  Both  types  of  tasks  are  train¬ 
ed  simultaneously  when  raid  scenarios  are  run  with  other  units  on  the 
network.  Display-console  operating  tasks  can  be  trained  separately 
when  a  raid  scenario  is  run  without  other  units  participating.  No 
maintenance  training  is  possible  with  Missile  Minder  ET. 
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Training  Uses.  Although  Missile  Minder  ET  is  capable  of  providing 
individual  training,  the  equipment  is  seldom  available  for  this 
purpose.  Usually,  ET  is  used  for  preparatory  exercises  before  a  readi¬ 
ness  evaluation.  This  provides  team  training,  since  most  preparatory 
exercises  have  various  participating  units.  Raid  tapes  are  also  used 
during  readiness  evaluations,  by  the  evaluation  teams. 

Training  Types.  Missile  Minder  ET  is  generally  used  for 
fullmission  scenario  training,  but  it  is  possible  to  have  a  raid  tape 
which  has  only  a  part-mission  scenario.  The  creation  of  such  a  raid 
tape  depends  on  the  Software  Support  Center.  No  part-task  training  is 
possible  with  Missile  Minder  ET. 

Training  Levels.  Missile  Minder  ET  is  used  for  sustaining  opera¬ 
tor  proficiency.  All  initial  training  is  performed  at  the  school,  and 
there  is  no  provision  for  training  operators  to  a  mastery-level  of 
performance.  Jlastery-level  training  is  possible  if  a  raid  tape  with  a 
challenging  scenario  is  created  at  the  Software  Support  Center. 
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IMPROVED  HAWK  (IHAWK)  MISSILE  SYSTEM  TPQ-29  TRAINER 


IHAWK  is  an  all-weacher,  radar-guided,  anti-aircraft  missile 
system.  It  is  deployed  either  in  a  "square"  configuration,  which  has 
one  base  firing  platoon  and  one  assault  firing  platoon,  or  a  "triad" 
configuration,  which  has  one  base  firing  platoon  and  two  assault  firing 
platoons.  Assault  firing  platoons  and  base  firing  platoons  are  deploy¬ 
ed  in  different  locations.  The  weapon  system  consists  of  a  several 
remotely  controlled  radar  units  for  target  detection  and  tracking, 
missile  launchers,  a  battalion-level  control  station,  and  a  battery- 
level  control  station.  Figure  C-1  shows  an  IHAWK  missile  system  in  a 
square  configuration. 


Figure  C-1.  IHAWK  Missile  System  Components 


A  mission  sequence  begins  with  the  improved  continuous-wave  acqui¬ 
sition  radar  (ICWAR)  and  improved  pulse-acquisition  radar  (IPAR) . 

These  are  the  search  and  detect  radars.  When  the  ICWAR  or  IPAR  detects 
a  target,  it  transmits  target  information  to  the  information  coordina¬ 
tion  central  (ICC)  and  the  improved  battery  control  central  (IBCC).  At 
the  ICC,  the  target  is  processed  by  IFF  equipment  and  automatic  data 
processors  (ADPs) .  Once  the  target  has  been  identified  at  the  ICC,  the 
target  information  is  transmitted  to  the  IBCC. 
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In  Che  IBCC,  the  target  data  are  presented  on  Che  displays,  along 
with  target  assignments  for  Che  battery.  The  tactical  control  officer 
in  the  IBCC  selects  a  target  for  engagement  and  assigns  it  to  a  firing 
section.  The  improved  high-power  illuminator  radar  (IHIPIR)  Cracks  the 
target  and  provides  a  reference  signal  for  the  missile.  The  improved 
range-only  radar  (IROR)  provides  ranging  information  for  the  target  in 
an  ECM  environment.  In  flight,  the  missile  compares  Che  transmitted 
signal  from  the  IHPIR  or  IROR  with  Che  reflected  signal  from  the 
target,  and  adjusts  its  intercept  course  based  on  target  course  and 
speed. 

Component  Descriptions 

Display  and  Control.  Each  battalion  has  one  ICC,  and  each  battery 
has  one  IBCC.  The  IBCC  receives  assignments  to  engage  targets  from  Che 
ICC.  A  tactical  control  officer  assigns  one  of  Che  battery  firing  pla¬ 
toons  Co  engage  Che  target.  All  comnands  between  Che  IBCC  and  the 
firing  platoon  equipment  are  on  a  digital  link,  as  are  commands  from 
Che  ICC.  The  ICC  and  IBCC  also  communicate  on  a  voice  channel. 

Radar  Equipment .  The  IHAWK  weapon  system  has  five  trailer- 
mounted  radar  units  per  square  battery  and  seven  per  triad  battery. 

The  first  radar  unit  is  Che  ICWAR,  which  provides  low-  to  medium- 
altitude  search  and  detection  capabilities.  The  second  radar  unit  is 
the  IPAR,  which  provides  medium-  to  high-altitude  search  and  detection 
capabilities.  Each  square  battery  also  has  two  IHPIR  radar  units  (each 
one  being  linked  to  three  launching  stations) ,  which  Crack  targets  and 
illuminate  Che  targets  for  intercept  evaluation.  A  triad  battery  would 
have  two  additional  IHPIR  radar  units.  The  last  radar  unit  is  the 
IROR,  which  provides  range-only  illumination  of  a  target  in  an  ECM 
environment . 

Launching  Stations.  Each  square  battery  has  six  trailer-mounted 
launching  stations.  These  are  separated  into  two  firing  platoons.  A 
triad  battery  has  nine  launching  stations,  divided  into  three  firing 
platoons.  Each  launching  station  has  three  missiles  and  is  remotely 
controlled  from  the  IBCC.  Once  a  missile  is  launched,  it  is  guided  by 
its  own  guidance  system,  based  on  target  reflections  from  the  IHPIR  or 
IROR  radar  units. 

ET  Component .  The  AN/TPQ-29  is  van-mounted,  with  its  own  its  own 
console  for  monitoring  and  initializing  the  training  sessions.  There 
is  one  TPQ-29  per  battalion.  It  is  periodically  rotated  among  Che 
batteries  in  the  battalion.  It  is  a  strap-on  training  device,  using 
cables  to  carry  the  signals  that  stimulate  the  operational  equipment. 

ET  Training  Features 

Computer-Oriented  Features  .  The  TPQ-29  is  not  capable  of  CAI  and 
does  not  use  AI  or  computer-generated  graphics.  The  only  functions  of 
the  TPQ-29  are  to  stimulate  the  operational  equipment  and  Co  provide  a 
suitable  environment  for  CAI. 


Training  Management  Features .  The  TPQ-29  does  not  have  an 
adaptive  training  capability.  It  has  a  scenario  authoring  capability, 
but  IHAWR  battalions  are  not  given  specific  guidelines  or  target 
parameter  limits  to  ensure  that  meaningful  training  scenarios  are 
developed.  It  also  is  not  equipped  with  a  recordkeeping  or  on-'line 
scenario  modification  capability. 

Automated  Training  Features.  The  TPQ-29  does  not  have  any  auto¬ 
mated  trainee  features.  There  are  no  performance  feedback,  performance 
recording,  performance  measuring,  or  report  generation  capabilities. 
This  requires  all  evaluation  and  feedback  to  be  done  over-the- 
ahoulder. 

Scenario  Control  Features .  The  TPQ-29  does  not  have  any  scenario 
control  features.  All  scenarios  are  pr e-prog ranmed,  with  no  script 
input  capability.  This  increases  the  importance  of  the  careful 
scenarios  authoring. 

Instructional  Features.  The  TPQ-29  has  neither  a  demonstration 
mode,  which  could  be  used  by  a  traini.ig  officer  to  illustrate  advanced 
equipment  operations  for  the  trainee,  noi  a  user-help  facility,  which 
could  aid  the  training  officer  in  the  operation  of  the  TPQ-29,  since  it 
is  a  specialized  piece  of  equipment  with  no  commonalities  with  the 
IHAWK  system. 

ET/System  Coordination  Features.  The  TPQ-29  is  a  strap-on  ET 
device.  It  is  only  capable  of  off-line  operation.  The  off-line 
restriction  has  a  negative  effect  on  the  equipment  availability,  since 
IHAWK  battalions  have  very  stringent  State-of-Readiness  (SOR) 
requirements.  Not  only  has  the  fact  that  it  is  a  strap-on  device 
restricted  the  availability  of  the  equipment  for  training  but  has  also 
increased  the  difficulty  of  using  the  TPQ-29.  It  is  not  capable  of 
presenting  simulated  targets  on  the  communications  net,  for  training 
coordinated  tasks  with  other  units. 


Factors  Affecting  Training  with  ET 

Logistical  Impact  Factors.  Because  it  is  an  added-on  training 
device  that  straps  onto  the  actual  equipment,  the  TPQ-29  has  many 
unique  parts  which  had  to  be  added  to  the  IHAWK  battalion  spare  parts 
inventories.  For  this  same  reason,  battalion  maintenance  responsibili¬ 
ties  increased.  Equipment  wear  has  increased  due  to  the  difficulties 
of  hooking  the  TPQ-29  to  the  actual  equipment.  For  example,  one  diffi¬ 
culty  in  particular  is  the  male-to-female  connections.  Connecting  the 
TPQ-29  often  produces  bent  male  connector  pins,  which  require  repair 
before  they  can  be  used  again. 

Time  Impact  Factors.  One  of  the  major  factors  limiting  the  use  of 
the  TPQ  29  has  been  the  low  relxaL}xli.ty  of  IHAWK  XLbeli.  OxLen  wnen 
the  TPQ-29s  have  been  available  for  training,  the  IHAWK  systems  nave 
been  unavailable.  Also,  personnel  are  seldom  available  for  training, 
due  to  additional  battery  duties  or  operational  requirements.  Training 
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staff  is  also  severely  limited  by  battalion  tasking.  The  training  time 
problem  is  exacerbated  by  the  fact  that  there  is  only  one  TPQ-29  per 
battalion,  forcing  each  battery  to  share  the  time  for  the  TPQ-29. 
Generally,  each  battery  is  scheduled  for  two  16-hour  training  periods 
per  month. 

A  factor  that  contributed  to  the  availability  problem  is  that  the 
IHAWR  missile  system  was  first  developed  in  the  early  19608,  when 
trainers  like  the  TPQ-29  were  neither  cost-effective  nor  technologic¬ 
ally  feasible.  Vftien  ET  became  both  feasible  and  cost-effective,  the 
TPQ-29  was  developed,  long  after  initial  weapon  system  delivery.  This 
is  what  led  to  the  strap-on  concept,  since  it  is  cheaper  to  build  an  ET 
device  without  having  to  modify  all  the  existing  IHAWK  weapon  systems. 
Building  strap-on  systems  also  has  no  effect  on  unit  readiness,  since 
units  are  not  losing  weapon  systems  during  the  modification  process. 

Operating  Impact  Factors.  The  TPQ-29  and  the  IHAWK  system  are  not 
real  difficult  to  operate,  but  they  lack  the  user-friendliness  that 
would  make  it  an  easy  system  to  use.  The  main  difficulty  has  been 
hooking  the  TPQ-29  to  (and  unhooking  it  from)  the  IHAWK  system.  Al¬ 
though  it  is  theoretically  possible  to  switch  from  the  simulator  mode 
to  the  tactical  mode  in  15  minutes,  the  average  user  estimate  of  hook¬ 
up  or  disconnect  time  is  one  hour — and  some  hook-up  times  have  been 
more  than  24  hours.  Thus,  it  can  take  more  time  to  hook  up  the  TPQ-29 
than  a  battery  may  have  available  for  using  the  device.  An  additional 
problem  is  that  the  TPQ-29  puts  out  lower  signal  levels  than  is  normal 
for  the  operational  equipment.  This  forces  operators  to  increase  the 
signal  gain  to  maximize  target  detection.  Many  users  feel  that  this 
detunes  their  IHAWK  system,  and  they  do  not  like  the  TPQ-29  for  that 
reason. 


Training  Functions  of  ET 

Task  Categories  Trained.  The  TPQ-29  is  used  primarily  to  train 
individual  operator  tasks.  The  only  team  tasks  trained  by  the  TPQ-29 
are  among  the  operators  of  one  IHAWK  system.  The  TPQ-29  is  not  capable 
of  maintenance  training. 

Training  Uses .  The  TPQ-29  is  only  used  for  operator  training. 

The  initial  concept  of  the  TPQ-29  was  to  provide  supplemental  training 
after  an  operator  leaves  school  and  arrives  at  the  unit.  The  school 
fails  to  train  many  of  the  critical  operating  tasks,  leaving  much  of 
the  operator  training  to  the  unit.  The  only  team  training  is  between 
the  enlisted  operator/repairman  and  the  artillery  officer. 

Training  Types .  The  TPQ-29  is  primarily  a  full-mission-scenario 
ET  device,  but  it  is  capable  of  part-mission-scenario  training  if  the 
scenario  is  authored  that  way.  The  TPQ-29  is  net  capable  of  part-task 
training . 
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Training  Levels.  The  TPQ-29  is  primarily  used  to  train  the  skills 
not  trained  at  the  schools.  The  fact  that  the  school  was  not  teaching 
all  of  the  critical  operator  tasks  and  skills  was  a  prime  reason  for 
developing  the  TPQ''29.  It  also  is  used  to  sustain  the  skills  learned 
at  the  unit  and  in  the  school.  It  is  not  used  to  train  beyond  basic 
operator  performance  requirements,  as  for  full-mastery  level  training. 
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WORLD-WIDE  MILITARY  COMMAND  AND  CONTROL  SYSTEM  (WWMCCS) 


WWMCCS  is  a  conmunicatlona  network  used  by  the  U.  S.  tri-services 
and  by  allied  forces.  Ihirty-three  of  the  34  WWMCCS  sites  are 
connected  on  an  information  system  called  the  WWKCCS  Information 
Network  (WIN).  The  Reesler  WWMCCS  site,  which  functions  only  as  a 
training  site,  is  the  only  site  not  included  on  WIN.  This  is  due  to 
the  high  security  nature  of  WIN.  WIN  provides  resource  information 
(e.g.;  number  of  ready  aircraft  at  base  "X,"  number  of  readj*  missiles 
at  base  "Y,"  nunber  of  ready  infantry  platoons  at  base  "Z,"  etc.)  that 
is  used  by  the  Joint  Operations  and  Planning  System  (JOPS)  to  make 
logistical  and  tactical  decisions.  WIN  uses  satellite  and  land 
communication  links  to  facilitate  the  network. 


Component  Descriptions 

Main  Unit .  WWMCCS  is  made  up  of  a  series  of  general-purpose 
computers  with  many  user  stations.  The  computers  are  connected  to  the 
comnunication  equipment  for  world-wide  information  transfer. 

ET  Component.  The  WWMCCS  training  mode  is  selectable  or  dese- 
lectable  in  less  than  a  minute.  There  is  a  simulation  mode  that  is 
capable  of  issuing  messages  concerning  resource  availability  and 
possible  tactical  requirements  for  training  joint  operations  and 
planning  systems  (JOPS)  operators.  Little  data  was  available  about  the 
simulation  capabilities,  but  it  is  known  that  WITMCCS  simulates  on  a 
very  high  tactical  level,  rather  than  simulating  a  specific  target 
environment.  There  is  a  scenario  library  with  scenarios  authored  by 
the  Joint  Chiefs  of  Staff  (JCS)  which  are  used  to  test  operational 
readiness.  Also,  WWMCCS  is  capable  of  running  CAI  tapes  to  teach 
various  related  knowledges. 


ET  Training  Features 

Computer-Oriented  Features .  Each  WWMCCS  site  can  run  CAI  napes. 
The  tapes  are  produced  at  Keesler  Air  Force  Base  or  at  the  WWMCCS  site. 
The  CAI  system  is  capable  of  sending  trainees  who  fail  particular  tests 
through  remedial  instruction  automatically.  Should  the  trainees  fail  a 
second  time,  they  are  returned  to  the  beginning  of  the  lesson.  Scores 
are  stored  for  each  trainee,  as  well  as  which  questions  were  missed  and 
the  time  it  took  to  complete  the  lesson. 

There  are  currently  25  ccurses  available  with  1S5  to  190  lessons. 

A  six-lesson  course  takes  about  one  year  to  develop  and  author,  before 
it  is  published  and  sent  to  the  other  WWMCCS  sites.  Tapes  are 
validated  in  the  field  and  the  trainee  results  are  sent  to  Keesler  AFB, 
to  aid  in  lesson  refinement.  The  topics  trained  with  CAI  vary  widely. 
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They  include  lessons  on  basic  equipment  operation,  computer  program¬ 
ming,  and  even  CAI  authoring  procedures.  WWMCCS  does  not  use  AI  or 
have  computer-generated  imagery  capabilities. 


Training  Management  Features.  The  CAI  is  capable  of  assigning  a 
trainee  to  remedial  instruction,  which  is  considered  a  form  of  auto¬ 
mated  adaptive  training.  Units  do  not  author  simulation  scenarios  but 
can  author  their  own  CAI  tapes.  WWMCCS  has  a  built-in  recordkeeping 
feature  for  maintaining  taining  performance  information.  Trainee 
results  from  CAI  are  sent  to  Reesler  AFB,  to  aid  in  CAI  tape  revision. 

Automated  Training  Features.  No  data  on  automated  features  of  the 
simulation  system  were  available;  however,  the  CAI  has  automated 
performance  measurement,  monitoring,  recording,  and  feedback.  It  is 
not  certain  whether  a  report  can  be  generated  by  WWMCCS  after  a  CAI 
session. 

Scenario  Control  Features .  No  data  were  available  about  the 
scenario  ccn^rol  features  of  the  WWMCCS  simulation  mode.  The  scenario 
freeze,  playback,  and  fast-forward  features  do  not  apply  to  the  CAI 
mode. 


Instructional  Features.  The  CAI  mode  does  not  have  a  demonstra¬ 
tion  capability  or  a  user-help  facility.  No  data  were  available  about 
the  simulation  mode. 

ET/System  coordination.  Both  the  simulation  mode  and  the  CAI  mode 
are  integrated  into  the  operational  equipment.  With  the  multiple  user 
stations,  a  large  number  may  be  used  for  CAI  while  others  are  being 
used  for  operational  purposes.  This  gives  WWMCCS  an  off-line  and  an 
on-line  capability.  The  entire  WIN  may  have  a  scenario  run  on  it, 
making  it  possible  to  train  and  assess  the  readiness  of  the  whole 
network. 


Factors  Affecting  Training  with  ET 

Logistical  Impact  Factors.  WWMCCS  has  no  notable  logistical 
impact  factors.  Adding  the  simulation  and  CAI  capabilities  did  not 
increase  the  nisnber  of  parts  required,  maintenance  requirements,  or 
equipment  wear.  There  are  no  differences  between  the  operational 
equipment  and  the  ET  equipment.  Additional  software  support  was 
required  for  the  CAI  training  system,  and  it  is  provided  by  the  train¬ 
ing  unit  at  Reesler. 

Time  Impact  Factors.  WWMCCS  is  a  highly  reliable- system  which  has 
few  system  failures.  Trainees  are  always  available  for  training, 
within  the  restrictions  of  their  regular  duty  requirements.  The 
equipment  is  always  available  for  training  purposes,  within  the  con¬ 
straints  of  operational  needs.  No  problems  resulted  from  having  ET 
added  after  initial  system  delivery,  since  there  were  no  hardware 
changes  to  the  system-— only  software  additions. 


Operating  Impact  Factors .  Both  the  CAI  and  the  simulation  modes 
are  easy  to  start  or  stop  using  WWMCCS.  WWMCCS  is  an  easy  system  to 
operate,  as  is  its  ET.  It  takes  one  minute  to  start  or  stop  a  WWMCCS 
CAI  tape  or  simulation  sequence. 


ET  Training  Functions 

Task  Categories  Trained .  WWMCCS  CAI  trains  the  knowledges 
associated  with  individual  equipment  operation  tasks  and  team  operation 
tasks.  The  simulation  mode  trains  team  tasks  and  tactical  decision 
tasks.  Equipment  operation  is  not  really  trained;  instead,  ET  trains 
reaction  performance  and  message  response. 

Training  Uses.  WWMCCS  CAI  is  mainly  used  for  individual  training: 
the  simulation  mode  is  usually  used  as  a  team  trainer  as  well  as  a 
readiness  assessment  tool  for  the  Joint  Chiefs  of  Staff.  The 
simulation  mode  is  not  used  very  frequently. 

Training  Types.  WWMCCS  simulations  are  full-mission  scenario 
simulations.  A  pait-miission  scenario  could  be  authored,  but  it  is  not 
likely  for  the  WIN  to  train  using  a  partial  scenario.  Part-task 
training  is  not  possible  on  the  WWMCCS.  CAI  is  a  special  type  of 
training  in  itself. 

Training  Levels.  After  assembling  the  data  about  the  simulation 
mode  and  CAI  mode,  WWMCCS  ET  was  evaluated  to  determine  the  level  to 
which  tasks  were  trained.  WWMCCS  CAI  was  found  to  train  both 
initial-level  s’ld  sustainment-level  knowledges.  The  simulation  mode  is 
strictly  used  for  sustainment  training  and  evaluation.  No  skills  are 
trained  to  full-mastery  levels,  but  it  is  possible  if  a  scenario  is 
authored  for  this  purpose. 
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F-15  ON-BOARD  SIMULATION  (OBS)  SYSTEM 


The  F-15  is  a  fighcer/bomber/ interceptor  aircraft.  The  F-15  can 
deploy  air-to-air  missiles,  air-to-aur face  rockets  and  bombs,  and  it 
has  a  gat  ling  gun  for  air-to-air  and  air-to-ground  engagements.  The 
sensors  used  are  radar  and  visual  sites.  A  Heads-Up  Display  (HUD) 
projected  on  the  cockpit  windshield  shows  target  location,  gun  cross, 
and  aircraft  flight  parameters.  The  pilot  uses  his  control  stick  for 
maneuvering,  communications,  and  weapons  delivery. 


Component  Description 

Electronics  Equipment.  The  F-15  is  equipped  with  a  central  com¬ 
puter  which  controls  the  radar,  IFF  interrogator,  inertial  navigation, 
HUD,  and  other  instrument  and  electronic  functions.  The  radar  system 
is  a  lightweight,  long-range  radar,  capable  of  detecting  small  targets 
at  all  altitudes.  The  radar  is  used  for  intercept  missions  and  radar- 
guided  air-to-air  missiles.  The  IFF  interrogator  identifies  the 
targets  for  the  pilot  and  a  programmable  signal  processor  enhances 
radar  capabilities  with  the  HUD  for  close-in  combat.  Figure  E-1  shows 
the  HUD  as  it  appears  in  the  cockpit,  with  its  symbology. 


E-2 


1 


ET  Component.  The  OBS  system  is  software  that  is  integrated  in 
the  aircraft's  digital  computers.  Activation  or  deactivation  takes 
less  than  one  minute  and  is  very  simple.  The  simulated  targets  are:  a 
flying  target,  when  in  the  air-to-air  mode,  or  a  fixed  ground  target, 
when  in  the  air-to-ground  mode  (both  of  which  are  displayed  on  the 
HUD).  The  same  operational  displays  and  controls  are  used  for  training 
with  the  OBS  system  as  are  normally  used  operationally.  Bullet  scoring 
models  are  contained  in  the  Air  Combat  Evaluator  (ACE)  software 
residing  in  the  aircraft  digital  computer. 


ET  Training  Features 

Computer-Oriented  Fectures.  The  OBS  system  does  not  have  a  CAI 
capability.  An  F-15  aircraft  would  not  seem  to  be  an  appropriate  envi¬ 
ronment  for  CAI.  The  software  does  not  use  AI  technology  or  computer¬ 
generated  imagery. 

Training  Management  Features.  The  OBS  is  not  an  automated 
adaptive  training  system.  Numerous  encounters  are  stored  in  the 
computer  memory  and  are  randomly  selected  for  the  pilot.  There  is  no 
scenario-authoring  capability,  but  the  random  selection  and  the  number 
of  encounters  stored  reduce  the  need  for  one.  There  is  no  built-in 
student  recordkeeping  facility.  A  recordkeeping  facility  would  most 
likely  have  to  be  an  external  device  that  would  receive  data  from  some 
kind  of  flight  data  recorder.  All  scenarios  are  preprogrammed,  with  no 
on-line  modification  capabilities. 

Automated  Training  Features.  The  OBS  does  not  provide  performance 
feedback  meaningful  for  training.  The  pilot  is  shown  the  predicted 
hits  and  the  position  of  his  bullet  stream  relative  to  the  target  or, 
in  the  case  of  the  air-to-ground  engagement,  the  distance  from  a  target 
that  a  bomb  landed.  There  is  no  recording  of  scenario  dynamics  or 
operator  performance,  which  could  be  used  for  reconstruction  of  the 
scenario  events  for  debrief  and  detailed  analysis.  There  is  no 
automated  performance  measurement  other  than  the  number  of  predicted 
hits.  The  F-15  does  not  have  a  printer  and  the  OBS  does  not  extract 
data  that  could  be  used  for  report  generation. 

Scenario  Control  Features.  The  OBS  does  not  have  a  scenario 
freeze  or  scenario  fast-forward  capability.  The  F-15  is  not  a  suitable 
site  for  a  scenario  playback,  and  without  the  data  extraction  capabi¬ 
lity,  no  other  site  can  be  used  for  debriefing  on  the  scenario. 

Instructional  Features.  There  is  no  deswnstrat ion  mode  or  user- 
help  facility  in  the  OBS  system.  Both  of  these  features  may  be 
undesirable,  clue  to  the  nature  of  the  weapon  system  (one-seater) ; 
however,  both  could  be  useful  for  showing  pilots  who  have  not  used  the 
OBS  how  to  use  It. 

ET/ System  Coordination  Features.  The  OBS  is  fully  integrated  into 
the  wev<><>  system  computers.  When  it  run  in  an  on-line  mode,  it 
presents  all  of  the  enhanced  operational  characteristics  of  the 
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aircraft,  including  the  predicted  hits  and  the  bullets-at-target-range 
(BAIR)  symbol.  The  OBS  does  not  lick  simulated  targets  to  other 
participating  units.  It  is  used  solely  as  a  single-aircraft  trainer. 
In  fact,  when  training  with  the  OBS,  other  aircraft  are  not  permitted 
in  the  practicing  aircraft's  airspace,  for  safety  reasons. 

Factors  Affecting  Training  with  ET 

Logistical  Impact  Factors.  The  jBS  did  not  increase  the  number 
of  parts,  maintenance  requirements,  or  equipment  wear.  There  are  no 
equipment  differences  in  the  OBS;  however,  with  respect  to  an  actual 
combat  environment,  the  HUD  makes  up  a  small  portion  of  the  pilot's 
field  of  view,  making  targets  wnich  pass  off  the  HUD  disappear  until 
they  are  positioned  within  the  KUD  field  of  view  again.  This  prevents 
training  in  specialized  skills,  such  as  air  combat  maneuvering  tactics 
(i.e.,  an  ability  to  manuever  tv::lative  to  an  adversary  aircraft  and  to 
close  in  for  a  shot  while  guarding  against  counter-manuevers ) .  An 
additional  difference  is  that  pilots  do  not  experience  the  stimuli 
that  are  present  when  weapons  are  actually  fired  on  a  target  (i.e., 
vibration  or  sound).  Thus,  trigger  control  is  not  trained  using  the 
OBS. 

Time  Impact  Factors.  F-15  aircraft  have  high  reliability,  which 
makes  them  available  for  training,  within  the  normal  constraints  of 
operational  requirements.  Pilots  are  available  for  training,  within 
the  constraints  of  their  regular  duties.  The  OBS  has  been  developed 
as  a  result  of  the  integrated  flight/ fire  control  (IFFC)  program.  The 
IFFC  program  started  with  the  F-*1SB,  after  its  initial  delivery  to  the 
Air  Force.  No  problems  have  been  identified  as  a  result  of  adding  the 
OBS,  although  the  OBS  is  still  in  Che  experimental  phase  and  has  not 
been  implemented  into  all  active  Air  Force  squadrons. 

Operating  Impact  Factors.  The  OBS  is  easy  to  engage  and  stop. 
Difficulty  levels  are  selected  by  the  pilot,  which  permits  training  to 
be  carried  out  at  various  skill  levels.  The  F-13  aircraft  is  an 
extremely  sophisticated  aircraft  Chat  requires  extensive  training  Co 
qualify  pilots  and  Co  maintain  their  skills  and  knowledges.  The  OBS 
is  a  simple  system  to  operate,  with  one  switch  action  chat  engages  or 
disengages  Che  OBS  in  less  than  one  minute. 


ET  Training  Functions 

Task  Categories.  The  OBS  is  u  ed  for  training  gunnery  and 
bombing  skills  against  ground  targets  (when  in  air-to-ground  mode)  and 
gunnery  skills  against  air  targets  (when  iu  the  air-to-air  mode).  The 
OBS  provides  training  for  equipment-operation  Casks  only.  No  team 
tasks,  such  as  coordinated  bombing  and  strafing  attacks,  are  trained 
by  the  OBS.  The  OBS  does  not  train  any  maintenance  tasks. 


Training  Uses.  The  OBS  is  used  for  training  individual  pilots  in 
gunnery  and  bombing  skills.  There  is  no  team  training  capability,  and 
the  OBS  is  not  used  for  preparatory  exercises  or  readiness 
evaluat ions. 

Training  Types.  The  OBS  presents  scenarios  for  air-to-air  or 
air-to-ground  engagements.  These  engagements  are  part  of  a  typical 
mission  for  an  F— 15.  Thus,  the  OBS  is  a  part-mission  scenario  training 
device.  The  OBS  is  not  suitable  for  part-task  training. 

Training  Levels.  The  OBS  is  used  to  sustain  pilot  proficiency  in 
particular  skills.  The  OBS  is  not  suitable  for  initial  training.  It 
may  be  used  for  full-mastery  training  if  difficult  scenarios  are  stored 
in  the  computer. 
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AIRBORNE  WARNING  AND  CONTROL  SYSTEM  (AWACS) 


The  E-3A  aircraft  (a  modified  Boeing  707-320B)  is  the  platform  on 
which  the  AWACS  is  deployed.  AWACS  includes  an  array  of  radar,  IFF, 
and  communications  equipment  and  provides  a  jam-resistant  surveillance 
system  used  for  command,  control,  and  communications.  The  aircrew 
duties  are  divided  into  the  following  six  functional  mission  areas: 
battle  management,  surveillance,  weapons,  communications,  data 
processing  and  display,  and  sensor  systems. 


Component  Descriptions 

Operational  System.  The  main  sensor  of  the  AWAtS  is  its  radar. 
There  are  several  different  radai.s  employed  on  the  aircraft  for  air  and 
surface  surveillance.  IFF  equipment  automates  target  identification. 
The  main  control  station  for  AWACS  is  the  situation  display  console 
(SDC).  There  are  six  SDCs  in  the  E-3A  aircraft,  as  shown  in  Figure 
F-1 . 


ET  Component.  The  AWACS  ET  consists  entirely  of  the  software 
residing  in  the  AWACS  computers.  Training  is  performed  on  the  actual 
equipment,  with  no  additional  equipment  being  required.  Scenarios  are 
selected,  run,  and  installed  (created)  at  the  SDC.  Also,  simulator 
tapes  that  are  created  at  the  ground  training  facility  are  available  to 
be  played.  Activating  a  scenario  from  a  simulator  tape  or  installing  a 
scenario  manually  takes  at  least  15  minutes.  Entering  the  desired 
parameters  for  the  scenario  is  the  time  consuming  part  of  installation. 
The  deactivation  of  a  training  scenario  is  instantaneous  and  occurs 
automatically  when  an  alert  is  received  by  AWACS.  A  training  scenario 
can  also  be  manually  deselected  by  the  operator  at  any  time. 


ET  Training  Features 

Computer-Oriented  Features.  The  AWACS  ET  component  dees  not  have 
a  CAI  capability.  A  CAI  capability  might  be  useful  on  missions  that 
have  long  flight  times  to  the  tactical  area.  On  the  ground,  CAI  would 
probably  not  be  useful  in  the  aircraft  since  it  would  require  the 
aircraft  to  be  powered  up.  AWACS  ET  does  not  use  AI  technology  or 
computer-generated  imagery. 

Training  Management  Features.  The  AWACS  ET  component  does  have  a 
scenario-authoring  capability.  Scenarios  are  created  at  the  training 
facility  and  placed  on  a  magnetic  tape  for  playing  in  flight,  or  the 
Mission  Crew  Commander  (MCC)  can  direct  the  simulator  supervisor  to 
prepare  a  scenario  in  the  aircraft.  The  MCC  or  simulator  supervisor 
can  also  modify  scenarios  while  they  are  running  if  it  was  authored  in 
the  aircraft.  Taped  scenarios  are  preprogrammed  and  cannot  be  modified 
while  they  are  running.  AWACS  ET  iu  not  automatically  adaptive  and 
does  not  have  a  built-in  recordkeeping  capability. 
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Automated  Training  Features.  The  AWACS  has  a  data  extraction 
capability  which,  when  used  during  a  scenario,  records  scenario 
dynamics  and  operator  actions.  These  data  are  used  for  reconstructing 
the  scenario  for  a  detailed  analysis  and  to  aid  in  debriefing.  These 
data  are  also  used  for  in-flight  replay.  All  performance  feedback  and 
measurement  is  done  over-the- shoulder ,  since  there  is  no  automated 
capability.  Although  AWACS  has  a  printer,  no  report  is  generated  from 
the  scenario  recorded  data. 

Scenario  Control  Features.  The  AWACS  ET  component  has  scenario 
freeze,  scenario  playback,  and  scenario  fast-forward  capabilities.  The 
MCC  controls  the  scenarios  from  the  SDC,  where  the  scenario  control 
options  are  selectable. 

Instructional  Features.  AWACS  ET  does  not  have  a  demonstration 
mode,  which  an  MCC  would  find  useful  to  train  MCC  candidates.  There  is 
no  user-help  facility,  which  would  be  useful  for  the  MCC  candidates 
when  learning  to  operate  ET. 

ET/System  Coordination  Features.  This  ET  component  is  software 
that  is  integrated  into  the  operational  equipment.  This  device  can  be 
used  on-line  or  off-line.  It  can  also  send  simulated  targets  to  other 
participating  units  on  the  communications  net,  for  coordinated  training 
exercises. 


Factors  Affecting  Training  with  ET 

Logistical  Impact  Factors.  No  AWACS  ET  logistical  problems  were 
indicated.  There  was  no  increase  in  parts,  maintenance  requirements, 
or  equipment  wear  as  a  result  of  installing  the  ET  component.  The  ET 
component  has  some  specialized  procedures  for  running  a  simulation; 
however,  these  procedures  are  aided  with  cues  and  menus. 

Time  Impact  Factors.  AWACS  ET  was  designed  and  developed  along 
with  AWACS.  AWACS  is  a  reliable  weapon  system  and  is  normally 
available  for  operations  or  for  training.  The  ET  system  is  normally 
used  after  an  aborted  mission.  This  would  occur  when  a  subsystem  (such 
as  the  radar)  fails,  thus  preventing  the  aircraft  from  being  able  to 
complete  the  mission. 

Operating  Impact  Factors.  AWACS  ET  is  easy  to  operate  from 
startup  to  shutdown.  AWACS  itself  is  very  sophisticated,  with  many 
operators  interacting  together,  and  it  is  moderately  difficult  to 
operate.  Starting  an  ET  scenario  takes  approximately  15  minutes,  which 
is  a  rather  long  period  of  time.  It  takes  less  than  one  minute  to 
return  to  the  operational  mode  from  the  ET  mode.  If  during  an  ET 
training  session  the  AWACS  receives  an  alert  from  AWACS  sensors  or  from 
another  AWACS  unit,  the  ET  system  is  automatically  shutdown  and  AWACS 
is  returned  to  the  operational  mode. 
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ET  Training  Functions 


Task  Categories.  The  ET  component  trains  the  operators  in 
equipment  operation  and  in  their  team  operation  tasks.  The  AWACS  is  a 
sophisticated  weapon  system,  with  many  sensors  and  many  operators.  ET 
provides  them  with  training  in  their  own  positions  and  trains  them  to 
interface  with  the  other  operators.  ET  does  not  provide  any 
maintenance  training. 

Training  Uses.  ET  is  used  for  training  individuals  to  operate 
equipment  at  their  own  stations  and  for  training  teams  of  operators. 

In  addition,  other  units  can  participate  in  coordinated  training  with 
the  AWACS.  ET  also  is  used  in  preparatory  exercises  prior  to  readiness 
evaluations.  ET  is  not  used  for  readiness  evaluations. 

Training  Types.  ET  is  capable  of  providing  full-mission  scenarios 
and  part-mission  scenarios.  Which  type  of  scenario  is  prepared  depends 
on  the  author.  ET  is  not  used  for  part-task  training,  although 
scenarios  could  be  developed  to  support  part-task  training. 

Training  Level.  AWACS  ET  provides  sustainment  training  for 
operators  and  teams.  It  also  provides  a  medium  for  training  to 
full-mastery  level  when  a  scenario  is  developed  for  that  purpose. 
Full-mastery- level  scenarios  would  train  at  an  intensity  not  normally 
encountered  during  training  missions  or  exercises,  but  are  possible  in 
actual  combat.  All  initial  training  is  provided  at  the  school. 
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F-14  IN-FLIGHT  TRAINING  (I FT)  SYSTEM 


The  F-14A  aircraft  is  a  carrier-based  fighter.  Itc  armament 
consists  of  air-to-air  missiles  and  a  gatling  gun.  It  has  an  array  of 
sensors  and  electronic  equipment  that  includes  radar,  IFF,  ECM,  and 
ECCM.  The  aircraft  is  mainly  used  for  Combat  Air  Patrol  (CAP).  The 
aircrew  consists  of  a  pilot  and  a  radar  intercept  officer  (RIO),  both 
of  whom  operate  the  electronic  sensors. 


Component  Description 

Weapon  System.  The  primary  sensor  for  the  F-14  is  the  long-range 
radar,  which  can  detect  small  targets  at  all  altitudes  and  speeds.  The 
RIO  is  the  primary  radar  operator,  but  the  pilot  can  also  operate  the 
radar.  ECM  and  ECCM  equipment  provide  the  F-14  with  the  capability  to 
operate  in  most  hostile  environments.  The  weapons  employed  by  the  F-14 
include  three  air-to-air  missiles:  one  long-range  radar-guided 
missile,  one  medium-range  radar-guided  missile,  and  one  close-range 
heat-seeking  missile.  Also,  for  close-in  air-to-air  and  air-to-ground 
combat,  the  F-14  is  equipped  with  a  20-mm  gatling  gun. 

ET  Component.  The  IFT  is  software  contained  in  the  F-14  central 
computer.  Activation  requires  one  switch  action  by  the  pilot  and  three 
by  the  RIO.  The  IFT  provides  scenarios  for  training  the  deployment  of 
weapons  against  radar  contacts.  No  special  equipment  is  used  for 
training  with  the  IFT,  since  it  stimulates  the  operational  equipment 
and  is  contained  in  the  aircraft  computer. 


ET  Training  Features 

Computer-Oriented  Features.  The  IFT  does  not  have  a  CAI  capa¬ 
bility.  The  F-14  does  not  appear  to  provide  an  appropriate  environment 
for  CAI.  The  IFT  does  not  use  AI  technology  or  have  computer-generated 
imagery. 

Training  Management  Features.  The  IFT  does  not  have  adaptive 
scenarios.  Targets  fly  in  preprogrammed  paths  that  are  randomly 
selected  by  the  IFT — or  the  crew  members  can  select  a  specific 
scenario.  Every  quarter,  a  weapons  improvement  board  is  held  which 
discusses  IFT  improvements  and  other  weapon- related  improvements.  The 
IFT  is  not  updated  until  the  weapon  system  has  been  designated  for 
approved  improvements.  There  is  no  built-in  record-keeping  feature  in 
the  IFT.  The  F-14  does  not  provide  a  suitable  medium  for  storing 
trainee  data.  Without  storing  trainee  data  on  some  storage  medium,  it 
is  not  possible  to  download  the  trainee  data  at  an  alternate  site  at 
the  unit  or  the  debrief  center.  Scenarios  are  preprugramoied  and  cannot 
be  mc-dified  without  a  majot  systeoi  suftware  update. 


Automated  Training  Features,  The  F-14  IFT  provides  hit-and-miss 
performance  data  for  the  crew,  but  no  real  meaningful  performance  data 
for  training  feedback  is  presented.  Scenario  dynamics  and  operator 
performance  is  not  recorded  for  scenario  reconstruction.  Performance 
measurement  is  limited  to  the  number  of  properly  engaged  targets  or 
improperly  engaged  targets.  These  data  are  not  meaningful  for  training 
purposes.  The  F-14  does  not  have  a  printer,  but  if  the  data  were 
recorded  on  a  magnetic  Cape  cartridge,  performance  data  could  be 
printed  at  the  debrief  site. 

Scenario  Control  Features.  The  IFT  uses  preprogrammed  scenarios 
which,  once  started,  cannot  be  froaen  with  a  scenario  freeze  option  nor 
started  at  various  points  in  the  scenario.  Also,  without  the  recorded 
scenario  data,  there  is  no  replay  capability  in  the  F-14  or  at  the 
debrief  site. 

Instructional  Features.  The  F-14  is  not  equipped  with  a  demon¬ 
stration  mode  or  a  user-help  facility.  The  IFT  is  so  simple  in  its 
present  form  that  neither  of  these  features  would  appear  necessary. 

ET/System  Coordination  Features.  The  IFT  is  software  integrated 
into  the  F-14  electronic  equipment.  No  special  equipment  is  needed  for 
training  with  the  IFT.  The  IFT  is  an  on-line  training  device  that 
stimulates  the  actual  radar,  IFF,  ECM,  and  ECCM  equipment.  The  IFT 
cannot  send  simulated  targets  over  the  communications  net  for 
coordinated  training  with  other  units. 


Factors  Affecting  Training  with  ET 

Logistical  Impact  Factors.  Having  the  IFT  in  the  F-14  has  not 
increased  the  number  of  parts,  maintenance  requirements,  or  equipment 
wear.  There  are  no  significant  differences  between  the  actual  weapon 
system  operation  and  the  IFT  equipment.  The  simulation  fidelity  is 
good  and  simulated  targets  present  no  noticeable  differences  from 
actual  targets. 

Time  Impact  Factors.  The  F-14  is  a  highly  reliable  aircraft,  with 
no  significant  equipment  failures  leading  to  extended  system  down 
times.  The  crew  members  and  the  aircraft  are  always  available  for 
training,  within  the  normal  operational  constraints  and  unit  duties. 

The  IFT  was  developed  during  F-14A  development.  The  only  significant 
design  problem  has  been  the  available  memory  space  for  IFT  programs. 

The  IFT  was  engineered  with  a  minimal  amount  of  memory  space  and  no 
extra  memory  for  future  expansions.  This  limits  the  number  of 
scenarios  that  may  be  stored  in  the  IFT  memory  (and  their  complexity). 

Operating  Impact  Factors.  Starting  the  IFT  scenario  is  not 
extremely  difficult,  but  it  does  require  both  the  pilot  and  the  RIO  to 
actuate  switches.  This  is  not  seen  as  having  a  serious  impact  on 
training  with  the  IFT,  but  it  is  more  cumbersome  than  requiring  one 
switch  activation  by  one  crew  member.  Shutting  off  the  IFT  only 
requires  one  switch  action.  The  F-14  is  a  highly  sophisticated 
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aircraft,  which  requires  extensive  training  to  qualify  both  crewmen. 
Sustaining  these  skills  and  knowledges  requires  continual  training  at 
the  unit  and  in  the  air.  Operating  the  IFT  is  very  simple,  requiring 
minimal  effort  on  Che  part  of  the  crew  members.  The  IFT  initializes 
and  shuts  down  almost  instantly. 


ET  Training  Functions 

Task  Categories.  The  IFT  is  used  for  "switchology"  training  in 
individual  aircraft.  This  places  it  in  the  "equipment  operation 
training"  category.  It  also  provides  training  for  Che  team  tasks 
between  the  RIO  and  pilot  but  not  Chose  among  Che  crew  members  of 
different  aircraft.  The  IFT  does  not  provide  maintenance  training. 

Training  Uses.  The  IFT  is  normally  used  for  individual  training 
of  each  crew  member  and  team  training  of  both  crew  members.  The  IFT 
trains  some  of  Che  critical  operating  tasks  in  the  F-14,  but  not  all. 

It  is  useful  for  sustaining  chose  Cask  skills  during  normally  scheduled 
training  and  during  preparatory  exercises.  The  IFT  is  not  used  for 
readiness  evaluation. 

Training  Types.  The  IFT  does  not  train  all  of  the  critical 
mission  tasks  and  skills  chat  the  crew  members  need  to  sustain  after 
leaving  school.  Skills  such  as  air-to-air  gunnery  (with  the  gaCling 
gun)  cannot  be  trained  by  the  IFT.  This  classifies  the  IFT  as  a 
part-mission-scenario  training  device.  The  IFT  is  not  used  for 
part-task  training. 

Training  Levels.  The  IFT  provides  sustainment  training  cf  those 
switch  operation  tasks  chat  are  not  capable  of  being  trained  in  any 
other  way  within  the  units.  The  available  memory  limits  the  IFT 
scenarios  Co  basic  encounters,  with  no  full-oiasCer)'- level  scenarios. 

All  initial  training  is  provided  at  the  schools. 
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CG-47  AEGIS  WEAPON  SYSTEM 
AEGIS  COMBAT  TRAINING  SYSTEM  (ACTS) 


AEGIS  COMBAT  TRAINING  SYSTEM  (ACTS) 


The  Aegis  system  is  a  centrally  controlled  array  of  weapon  systems 
consisting  of  sonar,  radar,  and  various  weaponry.  The  Aegis  system  is 
currently  deployed  on  board  the  CG-47  class  cruisers  and  is  designated 
to  be  deployed  on  board  the  DDG-51  class  destroyers.  The 
highly-sophisticated  centralized  computer  system  correlates  the  target 
informat  ion ' from  the  different  sensors  and  automatically  accomplishes 
inter-tact ical  coonnunications.  The  CG-47  class  cruiser  performs  the 
following  missions: 

1.  Anti-Air  Warfare  (AAW)  against  aircraft  and  missiles. 

2.  Surface  Warfare  (SUW). 

3.  Anti-Submarine  Warfare  (ASW). 

4.  Support  and  control  of  airborne  aircraft. 

5.  Patrol,  evacuation,  blockage,  visit  and  search, 
surveillance. 

6.  Search  and  rescue. 

7.  Hydrographic  and  oceanographic  data  collection. 

8.  Support  of  unit,  group,  or  force  operations. 

Figure  H-1  on  the  following  page  illustrates  the  primary  weapon  systems 
and  their  locations  on  the  CG-47  class  cruisers. 

The  Combat  Information  Center  (CI)  is  the  location  of  the  sensor 
and  weapons  control  stations.  The  weapon  control  station  operators, 
controllers,  and  supervisors  in  the  CIC  include  the  following: 

1.  AAWO  -  .*''ti-Air  Warfare  Coordinator. 

2.  ACS  -  Air  Control  Supervisor. 

3.  AIC  -  Air  Intercept  Controller. 

4.  ARC  -  Air  Radar  Controller. 

5.  ASAC  -  Anti-Submarine  Warfare  Air  Controller. 

6.  CO  -  Cotmaanding  Officer. 

7.  CSC  -  Combat  System  Coordinator. 

8.  DMC  -  Data  Management  Console  operator. 

9.  EPC  -  Engagement  Planning  Console  operator. 

10.  EWCO  -  Electronic  Warfare  Console  Operator. 
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Figure  H-1.  CG-47  Class  Cruiser  Primary  Weapon  Systems  and  Locations 


11.  EWS  -  Electronic  Warfare  Supervisor. 

12.  FC  -  Fire  Control  system  operator. 

13.  GCCO  -  Gun  Control  Console  Operator. 

14.  GFCSS  -  Gun  Fire  Control  System  Supervisor. 

15.  IDS  -  Identification  Supervisor. 

16.  LCC  ~  Launch  Control  Console  operator. 

17.  MSS  -  Missile  System  Supervisor. 

18.  RSC  -  Radar  Set  Console/Radar  System  Controller. 

19.  SRC  -  Surface  Radar  Controller. 

20.  SSWC  -  Surface/Strike  Warfare  Coordinator. 

21.  TAO  -  Tactical  Action  Officer. 

22.  TIC  -  Tactical  Information  Coordinator. 

23.  UBS  -  Underwater  Battery  Supervisor. 

The  weapon  system  station  locations  in  Che  CIC  are  presented  in  Figure 
H-2  on  the  following  page. 


Component  Descriptions 

Artti-Air  Warfare  Systems.  The  CG-47  class  cruiser  is  equipped 
with  a  large  number  of  AAW  systems  and  subsystems  that  are  controlled 
by  station  operators  or  the  Aegis  system.  The  AAW  systems  on  Che  CG-47 
class  cruisers  include  the  following: 

1.  Aegis  Weapon  System  MK  7  Mod  3. 

a.  AN/SPY-lA  Radar  System. 

b.  Command  and  Decision  System  (C&D). 

c.  Weapon  Control  System  (WCS)  MK  1  Mod  0. 

d.  Fire  Control  System  (FCS)  MK  99  Mod  1. 

e.  Operational  Readiness  Test  System  (ORTS)  MK  1. 

f.  Aegis  Combat  Training  System  (ACTS). 

2.  AN/SPS-49(V)1  Air  Search  Radar  System. 

3.  AN/SPS-55  Surface  Search  Radar  System. 

4.  AIMS  MK  XII  Identification  Friend  or  Foe  (IFF)  System. 

5.  Decoy  Launching  System  (DLS)  MK  36. 

6.  AN/SIil-32(V)3  Countermeasures  Set. 

7.  PHALANX  Close-in  Weapon  System  (CIWS)  MK  15  Mod  2. 
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8.  Vertical  Launching  System  (VLS)  MK  141  Mod  (),  first 
installation  on  CG-52. 


9.  Gun  Fire  Control  System  (GFCS)  MK  86  Mod  9. 

10.  Gun  Mount  MK  45  Mod  0. 

Surface  Warfare  Systems.  The  CG-47  Aegis  Combat  System  has 
numerous  systems  and  subsystems,  some  which  are  shared  with  AAW 
equipment.  The  SUW  systems  on  the  CG-47  class  cruisers  include  the 
following: 


1.  AN/ SPY- 1 A  Radar  System. 

2.  AN/SPS-55  Surface  Search  Radar  System. 

3.  Command  and  Decision  System  (C&D). 

4.  Weapon  Control  System  (WCS)  MK  1  Mod  0. 

5.  Fire  Control  System  (FCS)  MK  99  Mod  1. 

6.  TOMAHAWK  Weapons  System  EX  32  Mod  (). 

7.  Gun  Fire  Control  System  (GFCS)  MK  86  Mod  9. 

8.  Gun  Mount  MK  45  Mod  0. 


Anti-Submarine  Warfare  Systems.  The  CG-47  class  cruiser  is 
equipped  to  perform  ASW  autonomously  or  in  conjunction  with  other  ASW 
units.  Some  of  the  ASW  systems  are  shared  with  AAW  and  SUW  systems. 
The  ASW  systems  on  the  CG-47  class  cruisers  include  the  following: 

1.  Command  and  Decision  System  (C&D). 

2.  Weapon  Control  System  (WCS)  MK  1  Mod  0. 

3.  AN/SQS-53A  Sonar. 

4.  AN/SQR-19  Tactical  Towed  Array  Sonar  (TACTAS). 

5.  AN/SQQ-28(V)2  Sonar  (LAMPS  MK  III)  Signal  Processing 
System. 

6.  AN/UYQ-25  Sonar  In-Situ  Mode  Assessment  System  (S^MAS). 

7.  Anti-Submarine  Warfare  Control  System  (ASWCS)  MK  116  Mod 

0. 

8.  Surface  Vessel  Torpedo  Tubes  (SVTT)  MK  32  Mod  14. 

9.  AN/SLQ-25  Torpedo  Countermeasures  Transmitting  Set 
(NTXIR) . 
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ET  Component .  ACTS  ia  software  resident  in  the  Aegis  central 
computer  which  provides  an  on-line  shipboard  coordinated  proficiency 
training  capability.  ACTS  provides  the  following  capabilities: 

1.  Operator  modifiable  scenarios. 

2.  The  ability  to  train  on  selected  combat  system  elements. 

3.  Simulations  that  provide  realistic  environments. 

4.  Support  for  recording  data  for  evaluation. 

ACTS  trains  the  operators  of  the  following  weapon  systems: 

1.  Command  and  Decision  (C&D)  System  MR  1. 

2.  Weapons  Control  System  (WCS)  MK  1  Mod  0. 

3.  Fire  Control  System  (FCS)  MK  99  Mod  1. 


ET  Training  Features 

Computer-Oriented  Features.  ACTS  does  not  have  a  CAI  capability.  , 
The  CG-47  class  cruiser  does  provide  a  suitable  environment  for  CAI 
with  multiple  user  stations  and  comfortable  knowledge  training 
atmosphere  in  CIC.  ACTS  does  not  use  computer-generated  imagery  or 
AI. 

Training  Management  Features.  ACTS  has  a  scenario  authoring 
capability  and  a  library  of  scenarios  stored  in  Che  computers. 

Scenarios  are  modifiable  when  running.  ACTS  scenarios  can  provide 
evasive  targets  for  training  although  this  is  not  the  same  as  automated 
adaptive  training  (a  feature  ACTS  does  not  have).  There  is  no  built-in 
recordkeeping  although  the  CIC  is  a  suitable  site  for  maintaining 
trainee  records. 

Automated  Training  Features.  ACTS  has  a  performance  recording 
feature  which  records  scenario  dynamics  and  operator  responses.  This 
can  be  printed  out  for  detailed  analysis  after  running  the  scenario. 
ACTS  does  not  provide  feedback  to  the  operators  or  measure  operator 
performance.  Performance  measurement  is  based  on  an  evaluation  of  Che 
recorded  scenario  and  operator  data  and  by  an  over- the- shoulder 
observation  by  a  training  officer. 

Scenario  Control  Features.  ACTS  has  a  scenario  replay  capability 
using  Che  recorded  scenario  data.  Playbacks  assist  the  training 
manager  in  providing  detailed  corrective  and  supportive  feedback  to  the 
trainees.  There  is  no  scenario  freeze  or  scenario  fast-forward 
feature. 

Instructional  Features.  ACTS  does  not  have  a  demonstration  mode 
which  would  be  useful  for  a  training  officer  to  illustrate  advanced 
equipment  operations  and  tactical  decision  making.  There  is  no  user- 
help  facility  which  could  be  useful  to  both  the  training  officer 
operating  ACTS. 


ET/ System  Coordination  Features.  ACTS  is  fully  integral  to  the 
Aegis  Combat  System.  ACTS  is  capable  of  being  run  in  either  off-line 
or  on-line  modes.  Specific  stations  can  be  selected  for  training  while 
the  other  stations  continue  to  operate  normally.  ACTS  can  send 
simulated  targets  on  the  communications  net  for  training  with 
participating  units. 


ET  Impact  Factors 

Logistical  Impact  Factors.  Including  ACTS  in  the  Aegis  Combat 
System  did  not  significantly  increase  the  number  of  parts  in  the  system 
or  the  maintenance  requirements  for  the  system.  ACTS  has  not  increased 
equipment  wear.  There  are  no  differences  between  the  ACTS  equipment 
and  the  Aegis  Combat  System  equipment.  ACTS  simulates  the  environment 
with  no  noticeable  artificial  target  characteristics. 

Time  Impact  Factors.  Aegis  is  highly  reliable  and  neither  ACTS 
nor  Aegis  have  had  significant  system  failures.  Trainees  are  always 
available  for  training  while  standing  watch  in  the  CIC.  ACTS  is  always 
available  within  normal  operational  constraints.  ACTS  was  developed 
during  the  development  of  the  Aegis  Combat  System. 

Operating  Impact  Factors.  ACTS  is  easy  to  initialize  and 
shutdown,  requiring  one  switch  action.  The  Weapon  system,  as  a  whole, 
is  highly  complex  with  many  operators,  systems,  and  subsystems 
interfacing.  Aegis  coordinates  most  of  these  activities  making  the 
operators'  tasks  less  numerous.  This  classifies  the  Aegis  Combat 
System  with  a  moderate  difficulty  level  of  system  operation.  ACTS  is 
menu  driven  and  extremely  simple  to  operate  resulting  in  an  easy 
operating  level.  Starting  up  the  ACTS  takes  approximately  five  minutes 
while  shutdown  takes  less  than  one  minute. 

Training  Functions  for  ET 

Task  Categories.  ACTS  Crains  equipment  operation  Casks  and  some 
coordinated  tasks  between  operators  and  other  units.  ACTS  stimulates 
equipment  at  the  tactical  decision  level  and  not  at  the  sensor  station 
level.  There  are  separate  sensor  station  stimulators  which  are  not  a 
part  of  ACTS.  No  maintenance  training  capabilities  are  provided  by 
ACTS. 


Training  Use.  ACTS  is  Used  to  Crain  operators  of  the  following 
equipment : 

1.  Command  and  Decision  (C&U)  System  MK  1. 

2.  Weapons  Control  System  (WCS)  MK  1  Mod  0. 

3.  Fire  Control  system  (tcs)  MK  99  Mod  1. 
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These  operators  are  trained  individually  and  as  teams.  ACTS  is  used 
for  preparatory  exercises  and  readiness  evaluations  prior  to 
deployment . 

Types  of  Training.  ACTS  provides  a  full-mission  scenario 
capability  as  veil  as  a  part-mission  scenario  capability.  This  only 
depends  on  the  scenario  authored.  ACTS  could  be  used  for  part-task 
training  but  is  not  normally  used  for  that  purpose. 

Training  Levels.  ACTS  scenarios  are  used  for  initial  training  cf 
Aegis  Combat  System  skills,  sustainment  training,  and  development  of 
those  skills  to  full  mastery.  There  is  currently  no  school  for  the 
Aegis  system,  so  Aegis  specific  skills  are  trained  upon  the  operator's 
arrival  to  the  ship. 
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DDG-993  combat  SIMULATION  TEST  SYSTEM  (CSTS) 


The  DDC-993  is  a  guided  missile  destroyer  capable  of  subsurface, 
surface,  and  surface-to-air  warfare.  The  combat  system  is 
computerized,  with  central  control  of  sensors  and  weapon  systems  taking 
place  in  the  Combat  Information  Center  (CIC).  The  sensors  are 
primarily  radar  and  sonar.  The  DDG-993  missions  include  the 
following: 

1.  Conduct  and  coordinate  Anti-Air  Warfare  (AAW)  against 
aircraft  and  missiles. 

2.  Conduct  and  coordinate  Anti-Submarine  Warfare  (ASW) 
ope  rat  ions. 

3.  Conduct  and  coordinate  Surface  Warfare  (SOW)  operations. 

The  DDG-993  class  destroyers  have  many  sensors  and  weapons.  Figure  I-l 
shows  the  primary  weapon  systems  and  their  locations  on  a  DDG-993  class 
destroyer.  Most  of  these  weapons  and  sensors  are  controlled  from 
weapon  system  stations  located  in  the  CIC.  The  weapon  system  station 
controllers,  operators,  and  supervisors  in  the  CIC  include  the 
following: 

1.  AAWC  -  Anti-Air  Warfare  Coordinator. 

2.  AD/T  -  Air  Director/Tracker. 

3.  AlC  -  Air  Intercept  Controller. 

4.  ASAC  -  Anti-Submarine  Warfare  Air  Controller. 

5.  ASWCSO  -  Anti-Submarine  Warfare  Control  System  Operator. 

6.  ATACO  -  Air  Tactical  Control  Officer. 

7.  BVP  D/T  -  Beacon  Video  Processor  Director/Tracker. 

8.  CO  -  Commanding  Officer. 

9.  D/TM  -  Director/Tracker  Monitor. 

10.  DMC  -  Data  Management  Console  operator. 

11.  EPC  -  Engagement  Planning  Console  operator. 

12.  EWO  -  Electronic  Warfare  Officer. 

13.  GCC  -  Gun  Control  Console  operator. 

14.  GCOC  -  Gun  Control  Officer's  Console. 
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Figure  I-l.  DDG-993  Class  Destroyer  Primary  Weapon  System  Locations 


15.  ID  -  Identification  cperator. 

16.  MEC  -  Missile  Engfi^ement  Controller. 

17.  RADIO  MOM  -  Radio  Monitor. 

18.  RCO  -  Radar  Control  Operator. 

19.  RSCO  ■*  AN/SPS-48E  Radar  Set  Control  Operator. 

20.  SLQ''32  OPR  -  AN/SLQ-32  Electronic  Warfare  Operator. 

21.  SQQ-28  -  AN/SQQ-28(V)2  SONAR  (I.AMPS  MK  111)  Signal 
Processing  System  Operator. 

22.  SQR~19  -  AN/SQR-19  Tactical  Towed  Array  Sonar  (TACTAS) 
operator . 

23.  SQS-53  -  AN/SQS-53B  SONAR  operator. 

24.  SSTWC  -  Sur face/Strike  Warfare  Coordinator. 

25.  SURF  D/T  -■  Surface  Detector/Tracker. 

26.  TAO  -  Tactical  Action  Officer. 

27.  TRK  SUP  -  Track  Supervisor. 

28.  Wee  -  Weapons  Control  Console  operator. 

29.  WCP  -  Weapons  Control  Panel  operator. 

30.  WEC  -  Weapons  Engagement  Coordinator. 

The  locations  of  the  weapon  system  stations  and  other  equipment  in  the 
CIC  are  shown  in  Figure  1-2  on  the  following  page. 

Component  Descriptions 

Anti-Air  Warfare  Systems.  The  AAW  systems  are  integrated  to 
permit  the  implementation  of  command  doctrine;  to  detect  targets  and 
determine  threats;  to  disseminate  tactical  information;  to  provide  for 
the  allocation,  assignment,  and  control  of  weapons  for  the  engagement 
of  air  threats;  and  to  assess  engagement  results.  The  equipment  used 
in  the  AAW  tasks  is  as  follows: 

1.  AN/SPS-48E  3-D  air  search  radar. 

2.  AN/ SPS-49(V)5  long-range  air  search  radar. 

3.  AN/SPS-55  surface  search  radar. 
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4.  AN/SYS-2  integrated  automatic  detection  and  tracking  (lADT) 
system. 

5.  ALMS  MK  XII  ident if icat ion- friend-or- foe  (IFF)  system. 

6.  AN/SLQ-32(V)3  countermeasures  set. 

7.  Decoy  launching  system  (DLS)  MK  36. 

8.  Combat  direction  system  (CDS),  with  the  Naval  Tactical  Data 
System  (NTDS  New  Threat  Upgrade  (NTU). 

9.  Weapons  Direction  Syctem  (WDS)  MK  14. 

10.  AN/SYR-l  communications  tracking  set. 

11.  Signal  Data  Converter  (SDC)  MK  72. 

12.  Missile  Fire  Control  System  (MFCS)  MK  74. 

13.  Gun  Fire  Control  System  (GFCS)  MK  86. 

14.  Inertial  Navigation  Set  (INS)  AN/WSN~5. 

15.  Guided  Missile  Launching  System  (GMLS)  MK  26. 

16.  Gun  mount  MK  45. 

Surface  and  Strike  Warfare  Systems.  The  SUW  and  strike  warfare 
equipment  has  some  coounonalit ies  with  AAW  equipment.  The  SUW  equipment 
is  used  for  defending  against  enemy  surface  vessels,  and  the  strike 
equipment  is  used  for  attacking  enemy  positions  ashore.  The  SUW  and 
strike  equipment  include  the  following: 

1.  AN/SPS-55  surface  search  radar. 

2.  OUTBOARD  Tactical  Signals  Exploitation  (TSE)  system. 

3.  TOMAHAWK  weapon  system  EX  32. 

4.  Gun  Fire  Control  System  (GFCS)  MK  86. 

5.  Target  Designation  Transmitter  (TDT)  MK  24  and  Control 
Unit  (CU)  MK  79  Mod  7. 

6.  Gun  mount  MK  45. 

Anti-Submarine  Warfare  Systems.  A  DDG-993  class  destroyer  is 
equipped  with  a  vast  array  of  ASW  systems  and  weaponry.  It  is  capable 
of  defending  itself  and  its  task  force  against  enemy  submarines.  It 
uses  its  own  sensors  and  coordinates  the  sensing  activities  of  ASW 
aircraft.  Its  complimen'.  of  ASW  weapon  systems  includes  a  Lamps  MK  III 
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ASW  helicopter.  The  ASW  systems  employed  on  a  DDG-993  class  destroyer 
include  the  following: 

1.  AN/SQS-53B  sonar. 

2.  AN/SQR-19  Tactical  Towed  Array  Sonar  (TACTAS). 

3.  AN/SQQ-28(V)2  Sonar  (Lamps  MK  III)  Signal  Processing 
System  (SSPS). 

4.  AN/UTQ-25  Sonar  IN-SITU  Mode  Assessment  System  (SSPS). 

5.  Anti-Submarine  Warfare  Control  System  (ASWCS)  MK  116. 

6.  Anti-Submarine  Rocket  (ASROC)  launcher  system  MK  16. 

7.  Surface  Vessel  Torpedo  Tubes  (SVTT)  MK  32. 

8.  an/ SLQ-25  Torpedo  Countermeasures  Transmitting  Set 
(NIXIE). 

ET  Component.  I'he  CSTS  is  a  dual-purpose  system,  with  specially 
integrated  hardware  and  software.  Originally,  CSTS  was  developed  as  a 
strap-on  system  (then  called  the  Combat  System  Test  Set).  Now,  in  its 
second  generation,  each  ship  has  a  CSTS  (now  called  the  Combat 
Simulation  Test  System)  integrated  within  the  ship.  The  hardware 
specific  to  the  CSTS  includes  several  general-purpose  computers  and  a 
Test  Control  Console  (TCC) ,  which  serves  as  the  instructor  station. 

The  ship's  combat  system  must  be  in  the  normal  operating  mode  prior  to 
starting  the  CSTS.  In  addition  to  the  simulation  capability  for 
training,  the  CSTS  also  provides  a  test  function  for  testing  the 
various  sensor  station  displays  and  weapon  system  equipment. 

The  systems  presently  tied  to  the  CSTS  include  the  conmand  and 
decision  system  (C&D),  the  radio  communications  system  (RCS),  the 
surveillance  and  AIMS  system  (SAS),  the  gun  fire  control  system  (GFCS), 
the  missile  fire  control  system  (MFCS),  the  underwater  fire  control 
system  (UFCS),  and  the  ships  log  and  gyro  system.  The  CSTS  provides 
simulated  targets  for  presentation  on  the  ship's  radar  and  sonar 
displays.  The  sonar  targets  are  active  targets  because  the  CSTS  is 
capable  of  stimulating  the  passive  acoustic  sensors.  The  CSTS  also 
provides  information  about  the  ship's  course,  speed,  pitch,  and  roll, 
in  order  to  simulate  a  realistic  combat  environment. 

The  CSTS  uses  either  preprogrammed  scenarios  (stored  on  magnetic 
disk)  or  scripted  scenarios  that  require  the  training  coordinator  to 
enter  the  data  according  to  a  defined  time  line.  The  CSTS  provides 
training  for  operators  in  the  CIC,  including  sonar,  radar,  and  tactical 
operators. 


ET  Training  Features 

Computer-Oriented  Features.  The  CSTS  does  not  have  a  CAI 
capability.  The  CIC  would  be  a  suitable  environment  for  a  CAI 
presentation.  The  CSTS  does  not  use  AI  or  have  computei^ger.erated 
imagery. 

Training  Management  Features.  Scenarios  may  be  authored,  using 
the  TCC  and  storing  them  on  the  magnetic  disk  drive.  Scripted 
scenarios  can  be  run  from  the  TCC.  Also,  the  training  manager  can 
modify  and  enter  scenario  data  while  the  scenario  is  running.  CSTS 
does  not  have  automated  adaptive  training  nor  a  built-in  recordkeeping 
capability. 

Automated  Training  Featurec.  The  CSTS  does  not  have  aviy  automated 
performance  measures.  There  is  no  perfomance  feedback,  performance 
measuring,  or  report  generation  capabilities.  It  is  possible  to  use 
the  NTDS  to  data  extract  mission  data,  and  then  to  compare  it  with 
known  scenario  target  tracks.  Tlie  only  other  performance  recording 
possible,  is  the  record  made  by  the  training  manager  during 
over-the-shoulder  observations. 

Scenario  Control  Features.  The  CSTS  does  not  have  a  scenario 
freeze  or  fast-forward  feature.  Since  no  data  is  recorded,  there  is  no 
scenario  playback  capability. 

Instructional  Features.  The  CSTS  does  not  have  a  demonstration 
mode  or  user-help  facility.  On  a  system  as  complex  and 
teamwork-oriented  as  the  DDG-993  combat  system,  a  demonstration  mode 
would  be  useful  to  the  training  manager,  for  shoving  advanced 
equipment-operation  techniques  and  team  operations  techniques  to  the 
CIC  operators.  The  CSTS  is  mostly  menu  driven  and  easy  to  operate, 
which  indicates  that  a  user-help  facility  is  not  necessary. 

ET/ System  Coordination  Features.  Although  the  CSTS  has  its  ot#n 
instructor  station  and  special  electronic  components,  all  of  it  is 
integrated  into  the  CIC.  This  classifies  it  as  an  integral  training 
system.  It  is  important  to  note  that  the  first-generation  CSTS  was  a 
strap-on  system  that  was  stationed  at  pier  side,  with  cables  that  were 
hooked  to  the  CIC  systems.  The  CSTS  can  be  operated  at  sea  or  at  pier 
side  in  its  present  integrated  form;  however,  operating  the  CSTS 
inhibits  the  CIC  stations  selected  for  training  from  performing  any 
operational  functions.  Part  of  the  CSTS  is  a  "link  4/11"  simulator, 
which  simulates  friendly  and  non-friendly  positions  on  the  link  4  and 
link  11  communications  networks.  This  is  only  simulated  on  the  CIC 
link  4  and  link  11  cHsplay  consoles;  it  is  not  networked  to  other 
par t ic i pat  lug  uuitt> 
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Factors  Affecting  Training  with  ET 


Logistical  Impact  Factors.  The  CSTS  has  several  major  pieces  of 
equipment  that  have  been  added  specifically  for  CSTS  operation.  The 
addition  of  this  equipment  has  significantly  increased  the  number  of 
parts  needed  in  the  inventories  of  the  DDG-993  class  destroyers.  With 
the  addition  of  this  equipment,  the  maintenance  responsibilities  have 
been  increased.  It  is  important  to  note  that  the  CSTS  has  a  testing 
mode  which  aids  in  the  maintenance  of  the  operational  equipment.  No 
additional  wear  caused  by  the  presence  of  the  CSTS  has  been  identified. 
There  are  significant  differences  between  the  CSTS  TCC  and  the  weapon 
system  operating  stations.  The  TCC  has  four  color  monitors  with  touch 
screens.  The  weapon  system  control  stations  have  only  monochrome 
monitors,  with  keyboards  and  special- function  keys. 

Time  Impact  Factors.  The  CIC  weapon  systems  and  equipment  are 
very  reliable,  with  no  significant  equipment  failures  causing  extended 
system  down-times.  CSTS  is  also  very  reliable  with  no  problems  with 
system  down-time.  The  CSTS  is  always  available  for  training,  as  long 
as  its  use  does  not  interfere  with  the  operational  needs  of  the  ship. 
Since  specific  stations  can  be  selected  for  simulation,  training  is 
easy  to  schedule  both  at  sea  and  in  port.  Trainees  are  always 
available,  within  the  constraints  of  their  regular  assigned  duties. 

The  CSTS  was  developed  as  a  test  set  after  development  and  design  of 
the  DDG-993  class  destroyer.  Later  the  CSTS  was  developed  into  its 
present  form,  as  a  training  and  testing  system.  This  type  of 
development  is  believed  to  be  very  costly,  although  no  specific  cost 
data  are  available. 

Operating  Impact  Fsc..ora.  The  CS'^’S  has  five  switches  for 
initiating  and  stopping  the  training  mode.  It  also  requires  some  data 
entry  (for  setup)  prior  to  running  a  scenario.  All  systems  in  the  CIC 
must  be  up  and  operationally  configured  before  the  CSTS  is  started. 
These  requirements  give  the  system  a  medium  difficulty  level  rating  for 
start-up  and  shutdown.  The  weapon  systems  are  fairly  complicated,  with 
a  central  control  and  automated  processing  of  target  data  in  the  CIC. 
The  weapon  system  has  been  given  a  medium  difficulty  level  for 
operation.  The  CSTS  is,  by  itself,  a  simple  system  to  operate,  but 
start-up  and  shutdown  times  are  over  one  minute. 

ET  Training  Functions 

Task  Categories.  The  CSTS  stimulates  several  weapon  systems  in 
the  CIC,  while  providing  equipment  operation  task  training.  It  also 
provides  team  s ys tern- ope  rat ing  training  when  multiple  weapon  system 
stations  are  stimulated  at  the  same  time.  The  CSTS  has  a  testing  mode 
that  aids  maintenance  personnel,  but  it  does  not  train  maintenance 
tasks. 


Training  Uses.  The  CSTS  is  used  for  individual  training,  team 
training,  and  preparatory  exercises.  When  an  individual  operator 
station  in  the  CIC  is  selected  for  training,  the  CSTS  is  used  for 
individual  training.  Also,  several  different  weapon  system  operators 
cau  be  given  team  training  at  the  same  time.  The  CSTS  is  also  used 
prior  to  readiness  exercises,  to  improve  the  ship's  fighting 
performance  and  to  prepare  for  the  predeployment  evaluations.  The  CSTS 
is  not  presently  used  during  these  readiness  exercises. 

Training  Types.  The  CSTS  is  capable  of  running  full-  or 
part-mission  scenarios  from  the  magnetic  disk  cartridge.  Scenarios  can 
also  be  run  based  on  a  written  script  with  the  training  manager 
entering  scenario  data.  The  CSTS  is  not  used  for  part-task  training. 

Training  Levels.  The  CSTS  provides  initial  training  for  newly 
arriving  operators.  One  of  the  reasons  the  CSTS  was  developed  into  its 
current  form  was  to  fulfill  the  training  and  personnel  requirements 
that  the  shore-based  schools  could  not  provide.  The  CSTS  is  capable  of 
tri'.ining  operators  to  the  full-mastery  level  if  challenging  scenarios 
are  authored. 
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provide?  (i.e.,  practice  with  seldom  seen  targets,  etc.) 

(specify) 


22.  Does  the  embedded  training  system  overtax  the  operational  system? 

YES  NO  (if  YES,  in  what  way  are  the  consequences  apparent?) 


23.  What  are  the  benefits  of  embedded  training  versus  cl aventional 
training?  (please  be  specific) 


24.  Do  you  feel  more  comfortable  In  a  battle  situation  with  personnel  who 
have  been  trained  using  embedded  training 

YES  NO 

25.  Do  personnel  using  embedded  training  reach  operator  proficiency  more 
rapidly  than  those  trained  by  conventional  means? 

YES  NO  (If  NO,  why  do  you  think  that  is?)  _ 


26.  How  is  embedded  training  scheduled? 
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27.  Whac  Is  Che  priority  for  embedded  training? 


28.  What  Is  the  availability  of  the  operational  systems  for  embedded 
training?  _ 


29.  What  Is  Che  availability  of  personnel  to  use  embedded  training? 


30.  Uhat  Is  the  average  usage  of  the  embedded  training  system  per 
month? 

_  Hours/per  person 

31.  What  types  of  training  take  place  on  the  embedded  training  system? 
(specify) 

_ Operations  Tasks  _ Maintenance  Tasks  _ Team  Tasks 

32.  Have  any  students  with  no  previous  formal  training  used  the  embedded 
training  system? 

YES  NO 


33. 

Refer  to  Question  32. 

How  Many? 

3^:. 

Refer  to  Question  32. 

What  type  of  training  did  they  receive? 

35. 

How  are  the  results  of 

embedded  trlanlng  segments  evaluated? 

36.  Is  the  embedded  training  system  tied  to  any  proficiency  or 
qualification? 

YES  NO  (If  YES,  specify)  _ 


37.  Hat  imbedded  training  resulted  in  any  "negative  transfer  of 
training? 

YES  NO  (If  YES,  specify)  _ 
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38.  Is  the  embedded  training  system  updated  as  the  weapons  system 
changes? 

YES  NO 

(If  YES,  who  causes  the  update;  who  determines  new  training 
requirements)  _ _ _ _  _ 


39.  Were  additional  command  staff  required  to  maintain  an  embedded 
training  system? 

YES  NO 

40.  Who  is  the  embedded  training  data  reported  to? 

_  No  one  _  Training  Officer 

_  Command  only  _  Higher  authority 

41.  What  problems  do  you  perceive  in  the  present  embedded  training  system, 
and  what  could  be  done  to  solve  them? 
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APPENDIX  L 

TRAINEE  DATA  GATHERING  FORM 


TRAINEE  DATA  GATHERING  FORM 


1. 

System  Name 

Date: 

Device  it 

2. 

Service  Branch: 

Navy 

Air  Force  Armjr  (Check  One) 

3. 

Command 

(Unit  Name) 

4. 

Location 

(Base)  (State) 

5. 

Pay  Grade 

Specialty 

( 1 . e . ,  radar , 

communications) 

6. 

Position 

time  in  military 

7.  Previous  experience  with  computer  based  training  systems. 

YES  NO 

8.  Civilian  Education  (check  highest  level) 

_ Some  High  School  _  High  School  Grad  ___  Technical  School  Grad 

_  AA/AS  BS/BA  MS/MA  _  PhD 

9.  Approximately  how  much  training  have  you  received  on  your  present 

embedded  training  system?  (In  hours  or  days)  _ 

10.  How  are  you  scheduled  for  training  sessions?  (Check) 

_  Posted  Schedule  (Includes  POD  or  Flight  Schedule) 

_  Verbally 

_  No  Formal  Schedule 

11.  Vfhen  does  embedded  training  normally  take  place?  (e.g.,  during 
practice  battle  problems,  during  off-hours,  etc) 


12.  What  Is  the  availability  of  the  embedded  training  system  for  training? 
(Circle  appropriate  description) 

Never  Sometimes  Usually  Always 

Available  Available  Available  Available 
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13.  What  Is  your  availability  for  using  the  embedded  training  system? 

Never  Sometimes  Usually  Always 

Available  Available  Available  Available 

14.  How  were  you  trained  to  utilize  the  embedded  training  system?  (Check 
one  or  more) 

_  On  the  embedded  training  system 

_  Used  computer  based  training 

_  Used  self-paced  written  materials 

_  Lectures 

Other _ _ 

15.  Describe  how  you  start  up  the  embedded  training  system  (if  someone  else 
does  it  for  you,  state  who  that  is) 


16. 

Using  the  embedded  training  system  is: 

(circle 

correct  answer) 

Extremely 

Very 

Difficult 

Easy 

Simple 

Difficult 

Difficult 

17. 

How  is  the  weapons 

system  to  operate? 

(circle) 

Extremely 

Very 

Difficult 

Easy 

Simple 

Difficult 

Difficult 

18. 

How  is  the  embedded 

training  system  cc 

1  operate? 

(circle) 

Extremely 

Very 

Difficult 

Easy 

Simple 

Difficult 

Difficult 

19.  How  does  the  embedded  training  system  differ  from  the  actual  equipment? 
(i.e.,  controls,  displays,  indicators) 


20.  Are  the  training  materials  presented  in  a  manner  which  makes  them  easy 
to  learn  from? 

YES  NO  (If  NO,  explain)  _ 


21.  Do  training  lessons  guide  you  to  the  next  action  required? 

YES  i;o 
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22.  Will  the  embedded  training  program  let  you  enter  into  the  lessonware  at 
different  points  (can  you  skip  ahead  without  working  all  lower  level 
lessons) ? 

YES  NO 

23.  What  are  the  different  modes  in  the  embedded  training  program? 

(Check) 

_  Part  Task  (practice  using  different  functions  and  controls) 

_  Computer  Aided  Instruction  (knowledge  and  procedure  which  are 

necessary  to  perform  higher  level  tasks) 

_  Full  Scenario  Training  (simulates  operational  environment) 

_  Degraded  Operations  (simulates  equipment  failures) 

_  Maintenance  Training  (for  operator  and  technicians) 

24.  How  long  does  it  take  to  go  from  embedded  training  to  the  full  normal 
operational  mode? 

_  Seconds/minutes 

25.  How  difficult  is  it  to  go  from  embedded  training  to  the  full  normal 
operational  mode? 

Extremely  Very  Difficult  Easy  Simple 

Difficult  Difficult 

26.  Are  embedded  training  lessons  tied  to  your  professional  qualiflca** 
tlons? 

YES  NO 

27.  Has  embedded  training  helped  you  gain  proficiency  in  performing  your 
duties? 

Not  at  all  Rarely  Somewhat  Usually  Always 

28.  Do  you  request  embedded  training  from  those  who  schedule  its  use? 

Never  Rarely  Occasionally  Always 

29.  Are  your  embedded  equipment  training  lessons  graded? 

YES  NO 

30.  How  is  embedded  training  data  gathered  _ 

31.  What  form  of  feedback  are  you  given  (debrief,  ??)  _ 
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32.  What,  If  any,  are  the  consequences  for  good  or  bad  embedded  training 
performance 


33.  When  vas  the  first  time  you  used  the  equipment  training  program? 
_  Honth/year 

34.  When  was  the  last  time  you  used  the  equipment  training  program? 

_  Month/year 

35.  Is  It  possible  to  damage  the  operational  equipment  by  using  the 
equipment  training  program  Improperly? 

YES  NO 

36.  Have  you  ever  had  to  interrupt  training  because  of  a  failure  In  the 
embedded  training  hardware/ software? 

YES  NO 

37.  Does  the  embedded  training  system  affect  the  operational  equipment  In  a 
negative  way  (wear  It  out,  etc)? 

YES  NO  (If  YES,  explain)  _ 


38.  Is  It  possible  to  be  Injured  If  the  embedded  training  program  Is  not 
used  properly? 

YES  NO 

39.  How  long  Is  a  typical  embedded  training  lesson? 

_  Minutes/hours 

40.  Can  the  embedded  training  program  be  run  while  the  operational  system 
Is  in  its  normal  operating  mode? 

YES  NO 

41.  What  do  you  see  as  the  biggest  benefit  of  embedded  training? 


42.  What  are  the  embedded  training  system  problems? 
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43.  If  you  had  the  assets  and  .authority,  how  would  you  solve  the  problems 
you  have  listed  In  Question  42? 


APPENDIX  M 

MAINTAINER  DATA  GATHERING  FORM 
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MAINTAINER  DATA  GATHERING  FORM 


Date: 

1. 

System  Name 

Device  # 

2. 

Service  Branch:  Navy 

Air  Force  Army 

(Check  One) 

3. 

Command 

‘  (Unit 

Name) 

4. 

Location 

(Base) 

(State) 

5. 

Brief  description  of  weapon  system  function 

6. 

Who  maintains  embedded 

training  software /hardware? 

7.  How  does  an  embedded  training  system  update  take  place? 


8.  Is  there  a  dedicated  group  tasked  with  embedded  training  updates? 


9.  Is  it  difficult  to  cause  a  needed  change  in  the  embedded  training 
package? 

YES  NO 

10.  Are  there  courseware/software/hardware  remarks  fed  back  from  the 
students? 

YES  NO 

11.  Is  embedded  training  used  for  maintenance  training?  YES  NO 

12.  Does  the  embedded  training  system  overburden  the  supply  system  with 
additional  parts  requirements? 

YES  NO 


13.  Is  the  embedded  training  system  user  friendly?  YES 


NO 


14.  What  problems  are  perceived  with  the  embedded  training  system? 


15.  How  would  you  solve  them  If  you  had  the  assets  and  authority? 


i 
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